Aug 11 06:22:43 devstack cinder-volume[82934]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 06:22:43 devstack cinder-volume[82934]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 06:22:43 devstack cinder-volume[82934]: we strongly recommend against using it for new projects. Aug 11 06:22:43 devstack cinder-volume[82934]: If you are already using Eventlet, we recommend migrating to a different Aug 11 06:22:43 devstack cinder-volume[82934]: framework. For more detail see Aug 11 06:22:43 devstack cinder-volume[82934]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 06:22:43 devstack cinder-volume[82934]: import eventlet # noqa Aug 11 06:22:46 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:22:46 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:22:46 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:22:47 devstack cinder-volume[82934]: INFO dbcounter [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Registered counter for database cinder Aug 11 06:22:47 devstack cinder-volume[82934]: DEBUG oslo_db.sqlalchemy.engines [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG dbcounter [-] [82934] Writer thread running {{(pid=82934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.rpc [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.rpc [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG oslo_db.sqlalchemy.engines [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.volume.manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Determined volume DB was empty at startup. Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG cinder.volume.manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82934) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.volume.manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 11 06:22:48 devstack cinder-volume[82934]: WARNING stevedore.named [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 06:22:48 devstack cinder-volume[82934]: WARNING castellan.key_manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:22:48 devstack cinder-volume[82934]: WARNING cinder.keymgr.conf_key_mgr [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG cinder.volume.drivers.lvm [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82934) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG oslo_concurrency.processutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG oslo_concurrency.processutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] CMD "cinder-rtstool verify" returned: 0 in 0.496s {{(pid=82934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:48 devstack cinder-volume[82934]: DEBUG oslo_db.sqlalchemy.engines [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.rpc [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.rpc [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 11 06:22:48 devstack cinder-volume[82934]: WARNING stevedore.named [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 06:22:48 devstack cinder-volume[82934]: WARNING castellan.key_manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:22:48 devstack cinder-volume[82934]: INFO cinder.volume.manager [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_db.sqlalchemy.engines [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:22:49 devstack cinder-volume[82934]: INFO oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Starting 1 workers Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Started child 83202 {{(pid=82934) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Full set of CONF: {{(pid=82934) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] ******************************************************************************** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Configuration options gathered from: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] ================================================================================ {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] allow_availability_zone_fallback = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] allow_compression_on_image_upload = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[83202]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] allowed_direct_url_schemes = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] api_rate_limit = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] auth_strategy = keystone {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] az_cache_duration = 3600 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_availability_zone = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_host = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_stats_polling_interval = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backup_api_class = cinder.backup.api.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backup_name_template = backup-%s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backup_use_same_host = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backup_use_temp_snapshot = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] chap_password = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] chap_username = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_internal_tenant_project_id = 428dd2d250514abcb8cf40f924df7484 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_internal_tenant_user_id = 79b302d3544c4d0b9ce6c82af00ba45d {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cloned_volume_same_az = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cluster = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] compression_format = gzip {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] compute_api_class = cinder.compute.nova.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] config_dir = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] config_source = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] control_exchange = openstack {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] debug = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] default_availability_zone = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] default_group_type = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] default_volume_type = lvmdriver-1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] disk_geometry = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_client_cert = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_client_cert_key = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_data_namespace = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_ssl_cert_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_ssl_cert_verify = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] driver_use_ssl = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] enable_force_upload = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] enable_new_services = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] enable_unsupported_driver = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] enforce_multipath_for_image_xfer = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] filter_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_api_insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_api_ssl_compression = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[83202]: INFO cinder.volume.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_ca_certificates_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_catalog_info = image:glance:publicURL {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_num_retries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance_request_timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] goodness_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] graceful_shutdown_timeout = 5 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] group_api_class = cinder.group.api.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] host = devstack {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_compress_on_upload = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_conversion_address_space_limit = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_conversion_cpu_limit = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_conversion_disable = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_upload_use_cinder_backend = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_upload_use_internal_tenant = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_volume_cache_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_volume_cache_max_count = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] image_volume_cache_max_size_gb = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] init_host_max_objects_retrieval = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] instance_format = [instance: %(uuid)s] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iscsi_target_flags = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iscsi_write_cache = on {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iser_helper = tgtadm {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iser_ip_address = 192.168.122.113 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iser_port = 3260 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_color = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_config_append = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_dir = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_options = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_rotate_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_rotate_interval_type = days {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] log_rotation_type = none {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] max_age = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] max_logfile_count = 30 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] max_logfile_size_mb = 200 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] max_over_subscription_ratio = 20.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] message_reap_interval = 86400 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] message_ttl = 2592000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] migration_create_volume_timeout_secs = 300 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] monkey_patch = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] monkey_patch_modules = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] my_ip = 192.168.122.113 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] no_snapshot_gb_quota = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] num_iser_scan_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] num_shell_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] num_volume_device_scan_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] nvmeof_conn_info_version = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] nvmet_ns_id = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] nvmet_port_id = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_max_limit = 1000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_ext_list = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_listen_port = 8776 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_use_ssl = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] osapi_volume_workers = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] per_volume_size_limit = -1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] periodic_fuzzy_delay = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] periodic_interval = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] public_endpoint = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] publish_errors = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_backup_gigabytes = 1000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_backups = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_gigabytes = 1000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_groups = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_snapshots = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] quota_volumes = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] rate_limit_burst = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] rate_limit_except_level = CRITICAL {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] rate_limit_interval = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] reinit_driver_count = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] replication_device = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] report_discard_supported = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] report_interval = 120 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] reservation_clean_interval = 86400 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] reservation_expire = 86400 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] reserved_image_namespaces = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] reserved_percentage = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] rpc_response_timeout = 120 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] run_external_periodic_tasks = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] scst_target_driver = iscsi {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] scst_target_iqn_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_down_time = 720 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] shell_completion = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] snapshot_name_template = snapshot-%s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] snapshot_same_host = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] split_loggers = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] state_path = /opt/stack/data/cinder {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] storage_availability_zone = nova {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] storage_protocol = iSCSI {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] syslog_log_facility = LOG_USER {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_helper = lioadm {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_ip_address = 192.168.122.113 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_port = 3260 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_protocol = iscsi {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] target_secondary_ip_addresses = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] trace_flags = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] transport_url = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] until_refresh = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_chap_auth = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_default_quota_class = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_journal = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_json = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_multipath_for_image_xfer = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_stderr = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] use_syslog = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] verify_glance_signatures = enabled {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_api_class = cinder.volume.api.API {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_backend_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_clear = zero {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_clear_ionice = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_clear_size = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_copy_bps_limit = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_dd_blocksize = 1M {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_name_template = volume-%s {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_service_inithost_offload = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volume_usage_audit_period = month {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] zoning_mode = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_concurrency.disable_process_locking = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.auth_section = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.auth_type = password {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.auth_version = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.cache = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.include_service_catalog = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.interface = public {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_password = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcache_username = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.region_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.service_type = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.backend = dogpile.cache.null {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.backend_argument = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.backend_expiration_time = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.config_prefix = cache.oslo {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.debug_cache_backend = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.enable_retry_client = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.enable_socket_keepalive = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.expiration_time = 600 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.hashclient_retry_attempts = 2 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_dead_retry = 300 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_pool_maxsize = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_sasl_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.password = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.proxies = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.redis_db = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.redis_server = localhost:6379 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.retry_attempts = 2 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.retry_delay = 0.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.socket_keepalive_count = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.socket_keepalive_idle = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.socket_keepalive_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.socket_timeout = 1.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.tls_allowed_ciphers = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.tls_cafile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.tls_certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.tls_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.tls_keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cache.username = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] coordination.backend_url = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.asyncio_connection = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.asyncio_slave_connection = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.backend = sqlalchemy {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.connection = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.connection_debug = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.connection_parameters = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.connection_recycle_time = 3600 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.connection_trace = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.db_inc_retry_interval = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.db_max_retries = 20 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.db_max_retry_interval = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.db_retry_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.max_overflow = 50 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.max_pool_size = 5 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.max_retries = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.mysql_wsrep_sync_wait = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.pool_timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.retry_interval = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.slave_connection = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.sqlite_synchronous = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.synchronous_reader = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] database.use_db_reconnect = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.connection_string = messaging:// {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.es_doc_type = notification {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.es_scroll_size = 10000 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.es_scroll_time = 2m {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.filter_error_trace = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.hmac_keys = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.sentinel_service_name = mymaster {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.socket_timeout = 0.1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.trace_requests = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler.trace_sqlalchemy = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler_jaeger.process_tags = {} {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler_jaeger.service_name_prefix = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] profiler_otlp.service_name_prefix = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.enforce_new_defaults = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.policy_default_rule = default {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack sudo[83259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.policy_file = policy.yaml {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.group = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.helper_command = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] privsep_osbrick.user = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.group = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.helper_command = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] cinder_sys_admin.user = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.auth_section = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.auth_type = password {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.cafile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.collect_timing = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.send_service_user_token = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.split_loggers = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] service_user.timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.auth_section = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.auth_type = password {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.collect_timing = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.region_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.split_loggers = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] glance.timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.backend_availability_zone = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.chap_password = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.chap_username = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.disk_geometry = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_client_cert = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_client_cert_key = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_data_namespace = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.driver_use_ssl = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.extra_capabilities = {} {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.filter_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.goodness_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iscsi_target_flags = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iscsi_write_cache = on {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iser_helper = tgtadm {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iser_port = 3260 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.lvm_share_target = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.lvm_type = auto {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.num_shell_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.replication_device = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.report_discard_supported = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.reserved_percentage = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_helper = tgtadm {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_port = 3260 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_protocol = iscsi {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.trace_flags = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.unique_fqdn_network = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.use_chap_auth = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_backend_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_clear = zero {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_clear_ionice = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_clear_size = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_reports.file_event_handler = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_reports.log_dir = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.backend_host = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.chap_password = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.chap_username = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.disk_geometry = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_client_cert = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.extra_capabilities = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.filter_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.goodness_function = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iser_helper = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iser_ip_address = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iser_port = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.lvm_share_target = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.lvm_type = auto {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.num_shell_tries = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.replication_device = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.report_discard_supported = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.reserved_percentage = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.scst_target_driver = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.storage_protocol = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_helper = lioadm {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_ip_address = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_port = 3260 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.trace_flags = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.use_chap_auth = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_clear = zero {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_clear_size = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] lvmdriver-1.volumes_dir = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_notifications.driver = [] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_notifications.retry = -1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] key_manager.fixed_key = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.barbican_api_version = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.barbican_endpoint = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.barbican_endpoint_type = public {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.barbican_region_name = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.cafile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.collect_timing = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.number_of_retries = 60 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.retry_delay = 1 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.send_service_user_token = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.split_loggers = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.verify_ssl = True {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican.verify_ssl_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.auth_section = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.auth_type = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.cafile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.certfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.collect_timing = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.insecure = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.keyfile = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.split_loggers = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] barbican_service_user.timeout = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.approle_role_id = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.approle_secret_id = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.auth_method = approle {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.auth_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.kv_mountpoint = secret {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.kv_path = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.kv_version = 2 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.namespace = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.root_token_id = **** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.ssl_ca_crt_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.timeout = 60.0 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.token_file = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.token_role = None {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.use_ssl = False {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:22:49 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] ******************************************************************************** {{(pid=82934) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 06:22:49 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack sudo[83343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:49 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:49 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.256s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:22:49 devstack cinder-volume[83202]: INFO cinder.brick.local_dev.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:49 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:49 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:49 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:50 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:50 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:50 devstack cinder-volume[83202]: DEBUG cinder.brick.local_dev.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83202) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 11 06:22:50 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:50 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:50 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:51 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.447s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:51 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:51 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:51 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:51 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:51 devstack sudo[83869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 11 06:22:51 devstack sudo[83869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:52 devstack sudo[83869]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:52 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:52 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:52 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:52 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:52 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:52 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:52 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:52 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:52 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:52 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:52 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:52 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:53 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:53 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:53 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:53 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:53 devstack cinder-volume[83202]: INFO cinder.volume.drivers.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:53 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:53 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:53 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:53 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:53 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:53 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:53 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:54 devstack sudo[83902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:54 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:54 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:54 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:54 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:54 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:54 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:54 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:54 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:54 devstack cinder-volume[83202]: INFO cinder.volume.driver [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Driver hasn't implemented _init_vendor_properties() Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG cinder.volume.driver [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83202) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 06:22:54 devstack cinder-volume[83202]: DEBUG oslo_db.sqlalchemy.engines [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writer thread running {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG cinder.db.api [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Building query based on filter {{(pid=83202) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG cinder.image.image_utils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83202) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 06:22:55 devstack cinder-volume[83202]: INFO cinder.keymgr.migration [None req-dc24e8a2-be4c-40f8-b7f2-aeaf9efa206c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:55 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:55 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:55 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.405s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:55 devstack sudo[83954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:55 devstack sudo[83954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:55 devstack sudo[83954]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:55 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:55 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:55 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:56 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:56 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:56 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:56 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG cinder.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Notifying Schedulers of capabilities ... {{(pid=83202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:22:56 devstack cinder-volume[83202]: INFO cinder.volume.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Driver initialization completed successfully. Aug 11 06:22:56 devstack cinder-volume[83202]: INFO cinder.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Initiating service 2 cleanup Aug 11 06:22:56 devstack cinder-volume[83202]: INFO cinder.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Service 2 cleanup completed. Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG cinder.service [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Creating RPC server for service cinder-volume {{(pid=83202) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG cinder.service [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83202) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 06:22:56 devstack cinder-volume[83202]: INFO cinder.volume.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:56 devstack sudo[83967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:22:56 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:56 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:56 devstack sudo[83974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:56 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:57 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:57 devstack sudo[83979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:22:57 devstack sudo[83979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:57 devstack sudo[83979]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:22:57 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:22:57 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:22:57 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Aug 11 06:22:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:22:57 devstack cinder-volume[83202]: INFO cinder.volume.manager [None req-ad07bddd-5c55-44e9-8854-8bbb1996cbf4 None None] Driver post RPC initialization completed successfully. Aug 11 06:22:59 devstack cinder-volume[82934]: DEBUG dbcounter [-] [82934] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:23:07 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writing DB stats cinder:SELECT=3 {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:23:07 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:23:56 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:23:56 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:23:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:23:56 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:23:56 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:23:56 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Aug 11 06:23:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:23:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:23:56 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:23:56 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:23:57 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:23:57 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:23:57 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:23:57 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:23:57 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:23:57 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:23:57 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG cinder.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Notifying Schedulers of capabilities ... {{(pid=83202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager._thread_info {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread count: 6 {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:23:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread info: [<_MainThread(MainThread, started 140107951841408)>, , , , , ] {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:24:56 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:24:56 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:24:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:24:56 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:24:56 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:24:56 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Aug 11 06:24:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:24:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:24:56 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:24:56 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:24:57 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:24:57 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:24:57 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:24:57 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:24:57 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:24:57 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:24:57 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG cinder.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Notifying Schedulers of capabilities ... {{(pid=83202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager._thread_info {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread count: 6 {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:24:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread info: [<_MainThread(MainThread, started 140107951841408)>, , , , , ] {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:25:07 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:25:56 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:25:56 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:25:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:25:56 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:25:56 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:25:56 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Aug 11 06:25:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:25:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:25:56 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:25:56 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:25:57 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:25:57 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:25:57 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:25:57 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:25:57 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:25:57 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:25:57 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG cinder.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Notifying Schedulers of capabilities ... {{(pid=83202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager._thread_info {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread count: 6 {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:25:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread info: [<_MainThread(MainThread, started 140107951841408)>, , , , , ] {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:26:56 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:26:56 devstack cinder-volume[83202]: DEBUG cinder.volume.drivers.lvm [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Updating volume stats {{(pid=83202) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 11 06:26:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:26:56 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 11 06:26:56 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:26:56 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Aug 11 06:26:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:26:56 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:26:56 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:26:57 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:26:57 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:26:57 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 11 06:26:57 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:26:57 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:26:57 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 11 06:26:57 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:26:57 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_concurrency.processutils [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=83202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG cinder.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Notifying Schedulers of capabilities ... {{(pid=83202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG oslo_service.periodic_task [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] Running periodic task VolumeManager._thread_info {{(pid=83202) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread count: 6 {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:26:57 devstack cinder-volume[83202]: DEBUG cinder.volume.manager [None req-cbe83b8c-eabd-493a-9bb1-2772ecb76e6b None None] thread info: [<_MainThread(MainThread, started 140107951841408)>, , , , , ] {{(pid=83202) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:27:07 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writing DB stats cinder:SELECT=1 {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:07 devstack cinder-volume[83202]: DEBUG dbcounter [-] [83202] Writing DB stats cinder:UPDATE=1 {{(pid=83202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:16 devstack cinder-volume[82934]: INFO oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Caught SIGTERM, stopping children Aug 11 06:27:16 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Acquiring lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:16 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Acquired lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:16 devstack cinder-volume[82934]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Releasing lock "singleton_lock" {{(pid=82934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:16 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Stop services. {{(pid=82934) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 11 06:27:16 devstack cinder-volume[82934]: DEBUG oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Killing children. {{(pid=82934) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 11 06:27:16 devstack cinder-volume[82934]: INFO oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Waiting on 1 children to exit Aug 11 06:27:16 devstack cinder-volume[83202]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Acquiring lock "singleton_lock" {{(pid=83202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:16 devstack cinder-volume[83202]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Acquired lock "singleton_lock" {{(pid=83202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:16 devstack cinder-volume[83202]: DEBUG oslo_concurrency.lockutils [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Releasing lock "singleton_lock" {{(pid=83202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:17 devstack cinder-volume[83202]: WARNING amqp [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 06:27:17 devstack cinder-volume[83202]: WARNING amqp [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 06:27:17 devstack cinder-volume[82934]: INFO oslo_service.backend._eventlet.service [None req-98adf29b-f296-4b58-8a79-9e57b198e348 None None] Child 83202 exited with status 0 Aug 11 06:27:17 devstack cinder-volume[93638]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 06:27:17 devstack cinder-volume[93638]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 06:27:17 devstack cinder-volume[93638]: we strongly recommend against using it for new projects. Aug 11 06:27:17 devstack cinder-volume[93638]: If you are already using Eventlet, we recommend migrating to a different Aug 11 06:27:17 devstack cinder-volume[93638]: framework. For more detail see Aug 11 06:27:17 devstack cinder-volume[93638]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 06:27:17 devstack cinder-volume[93638]: import eventlet # noqa Aug 11 06:27:19 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:19 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:19 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:20 devstack cinder-volume[93638]: INFO dbcounter [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Registered counter for database cinder Aug 11 06:27:20 devstack cinder-volume[93638]: DEBUG oslo_db.sqlalchemy.engines [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:20 devstack cinder-volume[93638]: DEBUG dbcounter [-] [93638] Writer thread running {{(pid=93638) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:27:20 devstack cinder-volume[93638]: INFO cinder.rpc [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 06:27:20 devstack cinder-volume[93638]: INFO cinder.rpc [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 06:27:20 devstack cinder-volume[93638]: DEBUG oslo_db.sqlalchemy.engines [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:20 devstack cinder-volume[93638]: INFO cinder.volume.manager [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Determined volume DB was empty at startup. Aug 11 06:27:20 devstack cinder-volume[93638]: DEBUG cinder.volume.manager [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93638) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 06:27:20 devstack cinder-volume[93638]: INFO cinder.volume.manager [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 11 06:27:20 devstack cinder-volume[93638]: WARNING stevedore.named [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 06:27:20 devstack cinder-volume[93638]: WARNING castellan.key_manager [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:27:20 devstack cinder-volume[93638]: WARNING cinder.keymgr.conf_key_mgr [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:27:20 devstack cinder-volume[93638]: INFO cinder.volume.manager [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_db.sqlalchemy.engines [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93638) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:21 devstack cinder-volume[93638]: INFO oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Starting 1 workers Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Started child 93862 {{(pid=93638) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Full set of CONF: {{(pid=93638) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] ******************************************************************************** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Configuration options gathered from: {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] ================================================================================ {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] allow_availability_zone_fallback = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] allow_compression_on_image_upload = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] allowed_direct_url_schemes = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] api_rate_limit = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] auth_strategy = keystone {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_availability_zone = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_host = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_stats_polling_interval = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backup_api_class = cinder.backup.api.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backup_name_template = backup-%s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backup_use_same_host = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backup_use_temp_snapshot = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] chap_password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] chap_username = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_internal_tenant_project_id = 428dd2d250514abcb8cf40f924df7484 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_internal_tenant_user_id = 79b302d3544c4d0b9ce6c82af00ba45d {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cluster = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] compression_format = gzip {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] config_dir = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] config_source = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] control_exchange = openstack {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] debug = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] default_availability_zone = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] default_group_type = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] default_volume_type = QuobyteHD {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] disk_geometry = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_client_cert = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_client_cert_key = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_data_namespace = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_ssl_cert_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_ssl_cert_verify = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] driver_use_ssl = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] enable_new_services = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] enable_unsupported_driver = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] enabled_backends = ['QuobyteHD'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] enforce_multipath_for_image_xfer = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] filter_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_api_insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_api_ssl_compression = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_ca_certificates_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_num_retries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93862]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance_request_timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] goodness_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] graceful_shutdown_timeout = 5 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] group_api_class = cinder.group.api.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] host = devstack {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_compress_on_upload = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_conversion_address_space_limit = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_conversion_cpu_limit = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_conversion_disable = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_upload_use_cinder_backend = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_upload_use_internal_tenant = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_volume_cache_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_volume_cache_max_count = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] init_host_max_objects_retrieval = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] instance_format = [instance: %(uuid)s] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iscsi_target_flags = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iscsi_write_cache = on {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iser_helper = tgtadm {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iser_ip_address = 192.168.122.113 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iser_port = 3260 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_color = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_config_append = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_dir = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_options = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_rotate_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_rotate_interval_type = days {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] log_rotation_type = none {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] max_age = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] max_logfile_count = 30 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] max_logfile_size_mb = 200 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] max_over_subscription_ratio = 20.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] message_reap_interval = 86400 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] message_ttl = 2592000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] monkey_patch = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] monkey_patch_modules = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] my_ip = 192.168.122.113 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] no_snapshot_gb_quota = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] num_iser_scan_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] num_shell_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] num_volume_device_scan_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] nvmeof_conn_info_version = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] nvmet_ns_id = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] nvmet_port_id = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_max_limit = 1000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_ext_list = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_listen_port = 8776 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_use_ssl = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] osapi_volume_workers = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] per_volume_size_limit = -1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] periodic_fuzzy_delay = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] periodic_interval = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] public_endpoint = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] publish_errors = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_backup_gigabytes = 1000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_backups = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_gigabytes = 1000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_groups = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_snapshots = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] quota_volumes = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] rate_limit_burst = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] rate_limit_except_level = CRITICAL {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] rate_limit_interval = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] reinit_driver_count = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] replication_device = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] report_discard_supported = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] report_interval = 120 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] reservation_clean_interval = 86400 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] reservation_expire = 86400 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] reserved_image_namespaces = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] reserved_percentage = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] rpc_response_timeout = 120 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] run_external_periodic_tasks = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] scst_target_driver = iscsi {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] scst_target_iqn_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_down_time = 720 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] shell_completion = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] snapshot_name_template = snapshot-%s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] split_loggers = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] state_path = /opt/stack/data/cinder {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] storage_availability_zone = nova {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] storage_protocol = iSCSI {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] syslog_log_facility = LOG_USER {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_helper = lioadm {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_ip_address = 192.168.122.113 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_port = 3260 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_protocol = iscsi {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] target_secondary_ip_addresses = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] trace_flags = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] transport_url = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] until_refresh = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_chap_auth = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_default_quota_class = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_journal = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_json = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_multipath_for_image_xfer = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_stderr = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] use_syslog = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] verify_glance_signatures = enabled {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_api_class = cinder.volume.api.API {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_backend_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_clear = zero {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_clear_ionice = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_clear_size = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_copy_bps_limit = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_dd_blocksize = 1M {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_name_template = volume-%s {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_service_inithost_offload = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volume_usage_audit_period = month {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] zoning_mode = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.auth_section = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.auth_type = password {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.auth_version = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.cache = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.interface = public {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_password = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcache_username = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.region_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.service_type = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.backend = dogpile.cache.null {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.backend_argument = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.backend_expiration_time = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.config_prefix = cache.oslo {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.debug_cache_backend = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.enable_retry_client = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.enable_socket_keepalive = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.expiration_time = 600 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_dead_retry = 300 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_sasl_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.proxies = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.redis_db = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.redis_server = localhost:6379 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.retry_attempts = 2 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.retry_delay = 0.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.socket_keepalive_count = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.socket_keepalive_idle = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.socket_keepalive_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.socket_timeout = 1.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.tls_allowed_ciphers = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.tls_cafile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.tls_certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.tls_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.tls_keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cache.username = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] coordination.backend_url = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.asyncio_connection = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.asyncio_slave_connection = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.backend = sqlalchemy {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.connection = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.connection_debug = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.connection_parameters = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.connection_recycle_time = 3600 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.connection_trace = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.db_inc_retry_interval = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.db_max_retries = 20 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.db_max_retry_interval = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.db_retry_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.max_overflow = 50 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.max_pool_size = 5 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.max_retries = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.pool_timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.retry_interval = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.slave_connection = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.sqlite_synchronous = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.synchronous_reader = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] database.use_db_reconnect = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93862]: INFO cinder.volume.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Starting volume driver QuobyteDriver (1.2) Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.remotefs [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93862) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.connection_string = messaging:// {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.es_doc_type = notification {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.es_scroll_size = 10000 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.es_scroll_time = 2m {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.filter_error_trace = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.hmac_keys = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.sentinel_service_name = mymaster {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.socket_timeout = 0.1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.trace_requests = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler.trace_sqlalchemy = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler_jaeger.process_tags = {} {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] profiler_otlp.service_name_prefix = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.policy_default_rule = default {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.group = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.helper_command = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] privsep_osbrick.user = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.group = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.helper_command = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] cinder_sys_admin.user = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.auth_section = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.auth_type = password {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.cafile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.collect_timing = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.send_service_user_token = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.split_loggers = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] service_user.timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.auth_section = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.auth_type = password {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.collect_timing = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.region_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.split_loggers = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] glance.timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.backend_availability_zone = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.chap_password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.chap_username = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.disk_geometry = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_client_cert = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_data_namespace = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.driver_use_ssl = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.extra_capabilities = {} {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.filter_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.goodness_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iscsi_target_flags = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iser_port = 3260 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_host = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_login = admin {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_mount_options = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_private_key = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_share_path = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.replication_device = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.report_discard_supported = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_helper = tgtadm {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_port = 3260 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_protocol = iscsi {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.trace_flags = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.use_chap_auth = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_backend_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_clear = zero {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_reports.file_event_handler = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_reports.log_dir = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.backend_host = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.chap_password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.chap_username = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.chiscsi_conf = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.disk_geometry = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_client_cert = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.driver_use_ssl = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.extra_capabilities = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.filter_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.goodness_function = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iser_helper = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iser_ip_address = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iser_port = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.iser_target_prefix = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93862) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 11 06:27:21 devstack cinder-volume[93862]: WARNING cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 11 06:27:21 devstack cinder-volume[93862]: WARNING cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Running cmd (subprocess): mount.quobyte {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_host = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_login = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_mount_options = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_password = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_private_key = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_share_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_ssh_port = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.num_shell_tries = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.nvmet_port_id = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.replication_device = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.report_discard_supported = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.reserved_percentage = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.scst_target_driver = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.storage_protocol = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_helper = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_ip_address = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_port = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_prefix = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_protocol = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.trace_flags = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.use_chap_auth = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_clear = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_clear_size = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] QuobyteHD.volumes_dir = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_notifications.driver = [] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] key_manager.fixed_key = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.barbican_api_version = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.barbican_endpoint = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.barbican_endpoint_type = public {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.barbican_region_name = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.cafile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.collect_timing = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.number_of_retries = 60 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.retry_delay = 1 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.send_service_user_token = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.split_loggers = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.verify_ssl = True {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican.verify_ssl_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.auth_section = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.auth_type = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.cafile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.certfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.collect_timing = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.insecure = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.keyfile = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.split_loggers = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] barbican_service_user.timeout = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.approle_role_id = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.approle_secret_id = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.auth_method = approle {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.auth_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.kv_mountpoint = secret {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.kv_path = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.kv_version = 2 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.namespace = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.root_token_id = **** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.ssl_ca_crt_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.timeout = 60.0 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.token_file = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.token_role = None {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.use_ssl = False {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:21 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] ******************************************************************************** {{(pid=93638) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 06:27:21 devstack quobyte-client[93863]: Reading configuration file: /etc/quobyte/client.cfg Aug 11 06:27:21 devstack quobyte-client[93863]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=93862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:21 devstack cinder-volume[93862]: INFO cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 ... Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b -c /etc/quobyte/client-cinder.cfg {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:21 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b -c /etc/quobyte/client-cinder.cfg Aug 11 06:27:21 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:21 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.370s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:21 devstack cinder-volume[93862]: INFO cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 succeeded Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=93862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.379s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:21 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:21 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:21 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:22 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.231s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.volume.driver [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Driver hasn't implemented _init_vendor_properties() Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.volume.driver [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93862) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_db.sqlalchemy.engines [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG dbcounter [-] [93862] Writer thread running {{(pid=93862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.db.api [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Building query based on filter {{(pid=93862) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.image.image_utils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93862) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.keymgr.migration [None req-51bd7ab2-8df1-4e2e-ab8c-438b80510a7d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=93862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=93862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:22 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:22 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:22 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.239s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Notifying Schedulers of capabilities ... {{(pid=93862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.volume.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Driver initialization completed successfully. Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Initiating service 3 cleanup Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Service 3 cleanup completed. Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.service [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Creating RPC server for service cinder-volume {{(pid=93862) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.service [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93862) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.volume.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=93862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=93862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:22 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:22 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:22 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:22 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.252s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:22 devstack cinder-volume[93862]: INFO cinder.volume.manager [None req-7667256e-4bfc-4011-afa9-0e354ce928eb None None] Driver post RPC initialization completed successfully. Aug 11 06:27:24 devstack cinder-volume[93862]: DEBUG oslo_service.periodic_task [None req-b07e7d08-ea8f-4fff-aa08-7fc74f2a7eeb None None] Running periodic task VolumeManager._thread_info {{(pid=93862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:27:24 devstack cinder-volume[93862]: DEBUG cinder.volume.manager [None req-b07e7d08-ea8f-4fff-aa08-7fc74f2a7eeb None None] thread count: 6 {{(pid=93862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:27:24 devstack cinder-volume[93862]: DEBUG cinder.volume.manager [None req-b07e7d08-ea8f-4fff-aa08-7fc74f2a7eeb None None] thread info: [<_MainThread(MainThread, started 137543428927616)>, , , , , ] {{(pid=93862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=93862) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG cinder.volume.drivers.quobyte [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=93862) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93862) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:27 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:27 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:27 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG oslo_concurrency.processutils [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.232s {{(pid=93862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:27 devstack cinder-volume[93862]: DEBUG cinder.manager [None req-77ca2882-b836-44d2-a6a5-7e4333e814a6 None None] Notifying Schedulers of capabilities ... {{(pid=93862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:27:30 devstack cinder-volume[93638]: INFO oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Caught SIGTERM, stopping children Aug 11 06:27:30 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Acquiring lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:30 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Acquired lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:30 devstack cinder-volume[93638]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Releasing lock "singleton_lock" {{(pid=93638) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:30 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Stop services. {{(pid=93638) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 11 06:27:30 devstack cinder-volume[93638]: DEBUG oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Killing children. {{(pid=93638) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 11 06:27:30 devstack cinder-volume[93638]: INFO oslo_service.backend._eventlet.service [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Waiting on 1 children to exit Aug 11 06:27:32 devstack cinder-volume[93862]: DEBUG dbcounter [-] [93862] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:33 devstack cinder-volume[93862]: DEBUG dbcounter [-] [93862] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:35 devstack cinder-volume[93862]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 11 06:27:35 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Acquiring lock "singleton_lock" {{(pid=93862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:35 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Acquired lock "singleton_lock" {{(pid=93862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:35 devstack cinder-volume[93862]: DEBUG oslo_concurrency.lockutils [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Releasing lock "singleton_lock" {{(pid=93862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:35 devstack cinder-volume[93862]: WARNING amqp [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 06:27:35 devstack cinder-volume[93862]: WARNING amqp [None req-0e38bee9-b10e-4c67-8534-f1b17e04a2c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 11 06:27:36 devstack cinder-volume[94173]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 11 06:27:36 devstack cinder-volume[94173]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 06:27:36 devstack cinder-volume[94173]: we strongly recommend against using it for new projects. Aug 11 06:27:36 devstack cinder-volume[94173]: If you are already using Eventlet, we recommend migrating to a different Aug 11 06:27:36 devstack cinder-volume[94173]: framework. For more detail see Aug 11 06:27:36 devstack cinder-volume[94173]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 06:27:36 devstack cinder-volume[94173]: import eventlet # noqa Aug 11 06:27:38 devstack cinder-volume[94173]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 11 06:27:38 devstack cinder-volume[94173]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 11 06:27:38 devstack cinder-volume[94173]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 11 06:27:39 devstack cinder-volume[94173]: INFO dbcounter [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Registered counter for database cinder Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_db.sqlalchemy.engines [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG dbcounter [-] [94173] Writer thread running {{(pid=94173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:27:39 devstack cinder-volume[94173]: INFO cinder.rpc [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 11 06:27:39 devstack cinder-volume[94173]: INFO cinder.rpc [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_db.sqlalchemy.engines [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:39 devstack cinder-volume[94173]: INFO cinder.volume.manager [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Determined volume DB was empty at startup. Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG cinder.volume.manager [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94173) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 11 06:27:39 devstack cinder-volume[94173]: WARNING stevedore.named [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 11 06:27:39 devstack cinder-volume[94173]: WARNING castellan.key_manager [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:27:39 devstack cinder-volume[94173]: WARNING cinder.keymgr.conf_key_mgr [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 11 06:27:39 devstack cinder-volume[94173]: INFO cinder.volume.manager [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_db.sqlalchemy.engines [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:39 devstack cinder-volume[94173]: INFO oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Starting 1 workers Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Started child 94463 {{(pid=94173) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Full set of CONF: {{(pid=94173) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] ******************************************************************************** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] Configuration options gathered from: {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] ================================================================================ {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] allow_availability_zone_fallback = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] allow_compression_on_image_upload = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] allowed_direct_url_schemes = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] api_rate_limit = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] auth_strategy = keystone {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94463]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_availability_zone = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_host = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_stats_polling_interval = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backup_api_class = cinder.backup.api.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backup_name_template = backup-%s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backup_use_same_host = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backup_use_temp_snapshot = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] chap_password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] chap_username = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_internal_tenant_project_id = 428dd2d250514abcb8cf40f924df7484 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_internal_tenant_user_id = 79b302d3544c4d0b9ce6c82af00ba45d {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cluster = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] compression_format = gzip {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] compute_api_class = cinder.compute.nova.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] config_dir = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] config_source = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] control_exchange = openstack {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] debug = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] default_availability_zone = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] default_group_type = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] default_volume_type = QuobyteHD {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] disk_geometry = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_client_cert = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_client_cert_key = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_data_namespace = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_ssl_cert_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_ssl_cert_verify = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] driver_use_ssl = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] enable_new_services = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] enable_unsupported_driver = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] enabled_backends = ['QuobyteHD'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] enforce_multipath_for_image_xfer = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] filter_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_api_insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_api_servers = ['http://192.168.122.113/image'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_api_ssl_compression = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_ca_certificates_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_catalog_info = image:glance:publicURL {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_num_retries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance_request_timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] goodness_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] graceful_shutdown_timeout = 5 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] group_api_class = cinder.group.api.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] host = devstack {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_compress_on_upload = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_conversion_address_space_limit = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_conversion_cpu_limit = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_conversion_disable = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_upload_use_cinder_backend = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_upload_use_internal_tenant = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_volume_cache_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_volume_cache_max_count = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] image_volume_cache_max_size_gb = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] init_host_max_objects_retrieval = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] instance_format = [instance: %(uuid)s] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iscsi_target_flags = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iscsi_write_cache = on {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iser_helper = tgtadm {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iser_ip_address = 192.168.122.113 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iser_port = 3260 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_color = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_config_append = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_dir = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_options = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_rotate_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_rotate_interval_type = days {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] log_rotation_type = none {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] max_age = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] max_logfile_count = 30 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] max_logfile_size_mb = 200 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] max_over_subscription_ratio = 20.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] message_reap_interval = 86400 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] message_ttl = 2592000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] migration_create_volume_timeout_secs = 300 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] monkey_patch = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] monkey_patch_modules = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] my_ip = 192.168.122.113 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] no_snapshot_gb_quota = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] num_iser_scan_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] num_shell_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] num_volume_device_scan_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Starting volume driver QuobyteDriver (1.2) Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] nvmeof_conn_info_version = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94463) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] nvmet_ns_id = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] nvmet_port_id = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_max_limit = 1000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_ext_list = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_listen = 0.0.0.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_listen_port = 8776 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_use_ssl = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] osapi_volume_workers = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] per_volume_size_limit = -1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] periodic_fuzzy_delay = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] periodic_interval = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] project_id_regex = [0-9a-f\-]+ {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] public_endpoint = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] publish_errors = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_backup_gigabytes = 1000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_backups = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_gigabytes = 1000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_groups = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_snapshots = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] quota_volumes = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] rate_limit_burst = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] rate_limit_except_level = CRITICAL {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] rate_limit_interval = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] reinit_driver_count = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] replication_device = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] report_discard_supported = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] report_interval = 120 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] reservation_clean_interval = 86400 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] reservation_expire = 86400 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] reserved_image_namespaces = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] reserved_percentage = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] rpc_response_timeout = 120 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] run_external_periodic_tasks = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] scst_target_driver = iscsi {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] scst_target_iqn_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_down_time = 720 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] shell_completion = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] snapshot_name_template = snapshot-%s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] split_loggers = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] state_path = /opt/stack/data/cinder {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] storage_availability_zone = nova {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] storage_protocol = iSCSI {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] syslog_log_facility = LOG_USER {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_helper = lioadm {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_ip_address = 192.168.122.113 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_port = 3260 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_protocol = iscsi {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] target_secondary_ip_addresses = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] trace_flags = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] transfer_api_class = cinder.transfer.api.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] transport_url = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] until_refresh = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_chap_auth = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_default_quota_class = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_journal = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_json = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_multipath_for_image_xfer = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_stderr = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] use_syslog = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] verify_glance_signatures = enabled {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_api_class = cinder.volume.api.API {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_backend_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_clear = zero {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_clear_ionice = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_clear_size = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_copy_bps_limit = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_dd_blocksize = 1M {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_name_template = volume-%s {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_service_inithost_offload = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volume_usage_audit_period = month {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] zoning_mode = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_concurrency.disable_process_locking = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.auth_section = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.auth_type = password {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.auth_version = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.cache = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.delay_auth_decision = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.http_connect_timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.include_service_catalog = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.interface = public {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_password = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcache_username = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.region_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.service_token_roles_required = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.service_type = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.token_cache_time = 300 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.113/identity {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.backend = dogpile.cache.null {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.backend_argument = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.backend_expiration_time = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.config_prefix = cache.oslo {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.debug_cache_backend = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.enable_retry_client = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.enable_socket_keepalive = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.expiration_time = 600 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.hashclient_retry_attempts = 2 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_dead_retry = 300 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_pool_maxsize = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_sasl_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.proxies = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.redis_db = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.redis_sentinel_service_name = mymaster {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.redis_server = localhost:6379 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.retry_attempts = 2 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.retry_delay = 0.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.socket_keepalive_count = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.socket_keepalive_idle = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.socket_keepalive_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.socket_timeout = 1.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.tls_allowed_ciphers = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.tls_cafile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.tls_certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.tls_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.tls_keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cache.username = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] coordination.backend_url = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.asyncio_connection = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.asyncio_slave_connection = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.backend = sqlalchemy {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.connection = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.connection_debug = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.connection_parameters = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.connection_recycle_time = 3600 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.connection_trace = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.db_inc_retry_interval = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.db_max_retries = 20 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.db_max_retry_interval = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.db_retry_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94463) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 11 06:27:39 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.max_overflow = 50 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.max_pool_size = 5 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.max_retries = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.mysql_wsrep_sync_wait = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.pool_timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.retry_interval = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.slave_connection = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.sqlite_synchronous = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.synchronous_reader = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] database.use_db_reconnect = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.connection_string = messaging:// {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.es_doc_type = notification {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.es_scroll_size = 10000 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Running cmd (subprocess): mount.quobyte {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.es_scroll_time = 2m {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.filter_error_trace = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.hmac_keys = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.sentinel_service_name = mymaster {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.socket_timeout = 0.1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.trace_requests = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler.trace_sqlalchemy = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler_jaeger.process_tags = {} {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler_jaeger.service_name_prefix = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] profiler_otlp.service_name_prefix = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.enforce_new_defaults = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.policy_default_rule = default {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.policy_file = policy.yaml {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_policy.remote_timeout = 60.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.group = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.helper_command = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] privsep_osbrick.user = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.group = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.helper_command = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] cinder_sys_admin.user = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.auth_section = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.auth_type = password {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.cafile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.collect_timing = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.send_service_user_token = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.split_loggers = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] service_user.timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.auth_section = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.auth_type = password {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.collect_timing = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.region_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.split_loggers = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] glance.timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.backend_availability_zone = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.chap_password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.chap_username = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.disk_geometry = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_client_cert = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_client_cert_key = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_data_namespace = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.driver_use_ssl = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.enable_unsupported_driver = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.extra_capabilities = {} {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.filter_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.goodness_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iscsi_target_flags = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iscsi_write_cache = on {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iser_helper = tgtadm {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iser_ip_address = 192.168.122.113 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iser_port = 3260 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_host = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_login = admin {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_mount_options = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_private_key = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_share_path = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_ssh_port = 22 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.num_shell_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.nvmet_port_id = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_client_cfg = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack quobyte-client[94466]: Reading configuration file: /etc/quobyte/client.cfg Aug 11 06:27:39 devstack quobyte-client[94466]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.quobyte_volume_url = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.replication_device = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.report_discard_supported = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.reserved_percentage = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.scst_target_driver = iscsi {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.scst_target_iqn_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.storage_protocol = iSCSI {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_helper = tgtadm {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_ip_address = 192.168.122.113 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_port = 3260 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_protocol = iscsi {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.trace_flags = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.unique_fqdn_network = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.use_chap_auth = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_backend_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_clear = zero {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_clear_ionice = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_clear_size = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:39 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_reports.file_event_handler = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_reports.log_dir = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.backend_availability_zone = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.backend_host = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.chap_password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.chap_username = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.chiscsi_conf = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.disk_geometry = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_client_cert = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_client_cert_key = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_data_namespace = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.driver_use_ssl = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.extra_capabilities = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.filter_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.goodness_function = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iscsi_target_flags = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iscsi_write_cache = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iser_helper = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iser_ip_address = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iser_port = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.iser_target_prefix = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_host = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_login = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_mount_options = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_password = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_private_key = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_share_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_ssh_port = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.num_shell_tries = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nvmet_ns_id = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.nvmet_port_id = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.replication_device = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.report_discard_supported = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.reserved_percentage = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.scst_target_driver = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.storage_protocol = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_helper = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_ip_address = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_port = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_prefix = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_protocol = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.trace_flags = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.unique_fqdn_network = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.use_chap_auth = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_clear = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_clear_ionice = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_clear_size = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] QuobyteHD.volumes_dir = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.ssl_version = {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_notifications.driver = [] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_notifications.retry = -1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] oslo_messaging_notifications.transport_url = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] key_manager.fixed_key = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.barbican_api_version = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.barbican_endpoint = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.barbican_endpoint_type = public {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.barbican_region_name = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.cafile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.collect_timing = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.number_of_retries = 60 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.retry_delay = 1 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.send_service_user_token = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.split_loggers = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.verify_ssl = True {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican.verify_ssl_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.auth_section = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.auth_type = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.cafile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.certfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.collect_timing = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.insecure = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.keyfile = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.split_loggers = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] barbican_service_user.timeout = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.approle_role_id = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.approle_secret_id = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.auth_method = approle {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.auth_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.kv_mountpoint = secret {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.kv_path = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.kv_version = 2 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.namespace = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.root_token_id = **** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.ssl_ca_crt_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.timeout = 60.0 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.token_file = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.token_role = None {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.use_ssl = False {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 11 06:27:40 devstack cinder-volume[94173]: DEBUG oslo_service.backend._eventlet.service [None req-30820a4b-b3c5-475c-82d5-32ac6889b38c None None] ******************************************************************************** {{(pid=94173) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 11 06:27:40 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.volume.driver [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Driver hasn't implemented _init_vendor_properties() Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.driver [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94463) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writer thread running {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.db.api [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Building query based on filter {{(pid=94463) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94463) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.keymgr.migration [None req-d7d3de00-89c8-479c-b2de-65762e605feb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 11 06:27:40 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:40 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:40 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.234s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Driver initialization completed successfully. Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Initiating service 3 cleanup Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Service 3 cleanup completed. Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.service [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Creating RPC server for service cinder-volume {{(pid=94463) start /opt/stack/cinder/cinder/service.py:231}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.service [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94463) start /opt/stack/cinder/cinder/service.py:237}} Aug 11 06:27:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:27:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:27:40 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:27:40 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:27:41 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Aug 11 06:27:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.239s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:27:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c9753ce-c719-4db4-a81c-b615eb213274 None None] Driver post RPC initialization completed successfully. Aug 11 06:27:49 devstack cinder-volume[94173]: DEBUG dbcounter [-] [94173] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:50 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:27:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=2 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:28:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:28:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 6 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:28:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Flow 'volume_create_manager' (7907c63b-5668-40de-b5ed-9c5b9494a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eef455-8a3b-46c5-b62f-4e51ca9d0c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eef455-8a3b-46c5-b62f-4e51ca9d0c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1935467742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c3580-40a9-4ce3-8bd4-49f6f4623f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf8e3ccbae84b6ca4e89bfde2ce4639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:11Z,use_quota=True,user_id='c3c2c16601454b7b91f261fae648f08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4e036-596c-4480-906d-80b7386df13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd4e036-596c-4480-906d-80b7386df13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd373205-d9c7-4d81-be09-df4b8cfd1df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd373205-d9c7-4d81-be09-df4b8cfd1df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1c3580-40a9-4ce3-8bd4-49f6f4623f43', 'volume_name': 'volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6999028-9b23-4f22-8abf-5b3faa8b094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6999028-9b23-4f22-8abf-5b3faa8b094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af97d170-3a54-4812-9db2-89c9c69a5843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:11 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Volume 5f1c3580-40a9-4ce3-8bd4-49f6f4623f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43', 'volume_size': 1} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1935467742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c3580-40a9-4ce3-8bd4-49f6f4623f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf8e3ccbae84b6ca4e89bfde2ce4639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:11Z,use_quota=True,user_id='c3c2c16601454b7b91f261fae648f08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Creating volume 5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:29:11 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:29:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:12 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 1073741824 Aug 11 06:29:12 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:13 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 1073741824" returned: 0 in 1.572s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:13 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 Aug 11 06:29:13 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:14 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" returned: 0 in 0.529s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af97d170-3a54-4812-9db2-89c9c69a5843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee03a76-ce3b-4b43-a90b-a2be9b542000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Volume volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 (5f1c3580-40a9-4ce3-8bd4-49f6f4623f43): created successfully Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee03a76-ce3b-4b43-a90b-a2be9b542000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Flow 'volume_create_manager' (7907c63b-5668-40de-b5ed-9c5b9494a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f7d77671-93bf-498d-af7b-9f449f1bf7c8 tempest-VolumesAdminNegativeTest-173140453 None] Created volume successfully. Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:15 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:29:15 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:16 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.995s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 6 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Flow 'volume_create_manager' (48a4e5ba-8ff8-473b-ba55-fe4c872430e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82523cc-45cf-478c-be15-3fcb8d2fb521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82523cc-45cf-478c-be15-3fcb8d2fb521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-83833190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8456f678-68ec-470b-9bbc-f87324e99895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d8f7e5515641298eac65490478ef21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:16Z,use_quota=True,user_id='c86f466c79704fc4b056d09d2ca42e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1de4d2-e8f4-4530-8b4b-0a6f74b56477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1de4d2-e8f4-4530-8b4b-0a6f74b56477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcff597-75aa-414e-a24b-aa013429cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcff597-75aa-414e-a24b-aa013429cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8456f678-68ec-470b-9bbc-f87324e99895', 'volume_name': 'volume-8456f678-68ec-470b-9bbc-f87324e99895', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a626c650-d2a3-4f9e-a0fd-f72787f928f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a626c650-d2a3-4f9e-a0fd-f72787f928f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd4814d-f92d-4d4f-a92d-0b16e47716f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:16 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Volume 8456f678-68ec-470b-9bbc-f87324e99895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8456f678-68ec-470b-9bbc-f87324e99895', 'volume_size': 1} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-83833190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8456f678-68ec-470b-9bbc-f87324e99895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d8f7e5515641298eac65490478ef21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:16Z,use_quota=True,user_id='c86f466c79704fc4b056d09d2ca42e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Creating volume 8456f678-68ec-470b-9bbc-f87324e99895 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:29:16 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:29:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:16 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 1073741824 Aug 11 06:29:16 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Acquiring lock "cinder-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "cinder-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Acquiring lock "cinder-quobyte-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "cinder-quobyte-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" acquired by "delete_volume" :: waited 0.042s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:17 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_cxafmdq/privsep.sock'] Aug 11 06:29:17 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_cxafmdq/privsep.sock Aug 11 06:29:17 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:18 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 1073741824" returned: 0 in 1.858s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:18 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 Aug 11 06:29:18 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:19 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895" returned: 0 in 0.571s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] <== create_volume: return (2592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd4814d-f92d-4d4f-a92d-0b16e47716f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8456f678-68ec-470b-9bbc-f87324e99895', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e90bde7-1c8f-4095-9996-847b1160cdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:19 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Volume volume-8456f678-68ec-470b-9bbc-f87324e99895 (8456f678-68ec-470b-9bbc-f87324e99895): created successfully Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e90bde7-1c8f-4095-9996-847b1160cdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Flow 'volume_create_manager' (48a4e5ba-8ff8-473b-ba55-fe4c872430e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f2a1f107-0483-4d66-aff1-1c870fd02a43 tempest-ServerRescueNegativeTestJSON-551779162 None] Created volume successfully. Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 11 06:29:19 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 11 06:29:20 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 11 06:29:20 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: Aug 11 06:29:20 devstack cinder-volume[94463]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 11 06:29:20 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:20 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Spawned new privsep daemon via rootwrap Aug 11 06:29:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Accepted privsep connection to /tmp/tmp_cxafmdq/privsep.sock {{(pid=94463) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 11 06:29:20 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 11 06:29:20 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 11 06:29:20 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 11 06:29:20 devstack cinder-volume[94463]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95913 Aug 11 06:29:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c38544-90f3-40f8-9505-ba3da1be26c1]: (2,) {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:29:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a6966e-f86f-4ad5-958e-4bc3ce164ad3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:29:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:21 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 Aug 11 06:29:21 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:21 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" returned: 0 in 0.790s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:21 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43 Aug 11 06:29:21 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:22 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" returned: 0 in 0.592s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "cinder-quobyte-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43" released by "delete_volume" :: held 4.826s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:22 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:29:22 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Created reservations ['9da44e4a-ccdf-4d85-b4ea-fb9575529aa7', 'c6435f8b-591e-4524-a263-46a2a1452e87', 'b6a9a698-850a-42dc-92ab-8ff27ba19eb3', '408080ec-3708-4bac-9bed-266d713322e1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:23 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:29:23 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:23 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.943s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:23 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:29:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Deleted volume successfully. Aug 11 06:29:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1fb3ebc0-fcb1-4a93-a7d2-68e1573e0313 tempest-VolumesAdminNegativeTest-173140453 None] Lock "cinder-5f1c3580-40a9-4ce3-8bd4-49f6f4623f43-delete_volume" released by "delete_volume" :: held 6.772s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Flow 'volume_create_manager' (85879831-23ba-403e-814b-87aae013448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a13d1c-89c3-4bb5-bd3b-dd3895af56d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a13d1c-89c3-4bb5-bd3b-dd3895af56d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1865705599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e7e2c3-6222-47d6-9987-794ba6554d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778196a885084e1f8ee681c55d287447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:31Z,use_quota=True,user_id='6f3802be4c9c418badc75a85ddd6bba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73677bc-9da0-461a-b60b-98ff6146cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73677bc-9da0-461a-b60b-98ff6146cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e24a354-b71b-4699-aa1d-c2d64a37150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e24a354-b71b-4699-aa1d-c2d64a37150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e7e2c3-6222-47d6-9987-794ba6554d54', 'volume_name': 'volume-c8e7e2c3-6222-47d6-9987-794ba6554d54', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d81937-8046-45c1-8a77-d8ce8910feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d81937-8046-45c1-8a77-d8ce8910feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e25b5-a53b-4974-8d53-fd895477cffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Volume c8e7e2c3-6222-47d6-9987-794ba6554d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e7e2c3-6222-47d6-9987-794ba6554d54', 'volume_size': 1} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1865705599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e7e2c3-6222-47d6-9987-794ba6554d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778196a885084e1f8ee681c55d287447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:31Z,use_quota=True,user_id='6f3802be4c9c418badc75a85ddd6bba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Creating volume c8e7e2c3-6222-47d6-9987-794ba6554d54 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:29:31 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:29:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:31 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 1073741824 Aug 11 06:29:31 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:32 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 1073741824" returned: 0 in 0.913s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:32 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 Aug 11 06:29:32 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:33 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54" returned: 0 in 0.514s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e25b5-a53b-4974-8d53-fd895477cffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e7e2c3-6222-47d6-9987-794ba6554d54', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9eb68f-e2ff-4df3-bfce-d68d0329b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Volume volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 (c8e7e2c3-6222-47d6-9987-794ba6554d54): created successfully Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9eb68f-e2ff-4df3-bfce-d68d0329b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Flow 'volume_create_manager' (85879831-23ba-403e-814b-87aae013448f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dedf50c4-ca42-4c55-981c-6f6b72da7b7c tempest-ServersNegativeTestJSON-1232393045 None] Created volume successfully. Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Flow 'volume_create_manager' (26e103ce-a7be-4cb5-9d0a-942bd80ab1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efbd54e-a86e-45c4-b0a9-61436f6caaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efbd54e-a86e-45c4-b0a9-61436f6caaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-847304384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17d4d94-56d7-44c6-93fc-039ba02348d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778196a885084e1f8ee681c55d287447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:36Z,use_quota=True,user_id='6f3802be4c9c418badc75a85ddd6bba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e75127-9a53-4abe-a23b-73a6434935fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e75127-9a53-4abe-a23b-73a6434935fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4fcb46-0d29-4d22-ad4c-27a71fc972f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4fcb46-0d29-4d22-ad4c-27a71fc972f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17d4d94-56d7-44c6-93fc-039ba02348d1', 'volume_name': 'volume-f17d4d94-56d7-44c6-93fc-039ba02348d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac59578-a88c-4eaf-a41c-13f75c0a87dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac59578-a88c-4eaf-a41c-13f75c0a87dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8839b035-17cf-43cf-b9cd-1db83546a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:36 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Volume f17d4d94-56d7-44c6-93fc-039ba02348d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17d4d94-56d7-44c6-93fc-039ba02348d1', 'volume_size': 1} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-847304384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17d4d94-56d7-44c6-93fc-039ba02348d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='778196a885084e1f8ee681c55d287447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:29:36Z,use_quota=True,user_id='6f3802be4c9c418badc75a85ddd6bba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Creating volume f17d4d94-56d7-44c6-93fc-039ba02348d1 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:29:36 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:36 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 1073741824 Aug 11 06:29:36 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:36 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 1073741824" returned: 0 in 0.747s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:37 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 Aug 11 06:29:37 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:37 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8839b035-17cf-43cf-b9cd-1db83546a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17d4d94-56d7-44c6-93fc-039ba02348d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74bfc19-7e5c-4048-87fc-8a91faaed409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:29:37 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Volume volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 (f17d4d94-56d7-44c6-93fc-039ba02348d1): created successfully Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74bfc19-7e5c-4048-87fc-8a91faaed409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:29:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Flow 'volume_create_manager' (26e103ce-a7be-4cb5-9d0a-942bd80ab1f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:29:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1c4e4dff-7111-4f7d-b7b4-5695e7929bad tempest-ServersNegativeTestJSON-1232393045 None] Created volume successfully. Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "cinder-f17d4d94-56d7-44c6-93fc-039ba02348d1-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-f17d4d94-56d7-44c6-93fc-039ba02348d1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Acquiring lock "cinder-8456f678-68ec-470b-9bbc-f87324e99895-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "cinder-quobyte-f17d4d94-56d7-44c6-93fc-039ba02348d1" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "cinder-8456f678-68ec-470b-9bbc-f87324e99895-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-quobyte-f17d4d94-56d7-44c6-93fc-039ba02348d1" acquired by "delete_volume" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ead69c7-f000-4f79-b046-f61c694b0d57]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Acquiring lock "cinder-quobyte-8456f678-68ec-470b-9bbc-f87324e99895" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "cinder-quobyte-8456f678-68ec-470b-9bbc-f87324e99895" acquired by "delete_volume" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587f0f6-a6c1-4565-a6d4-1cdcb1998086]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:29:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:40 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 Aug 11 06:29:40 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:41 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 Aug 11 06:29:41 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:41 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1" returned: 0 in 0.609s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:41 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1 Aug 11 06:29:41 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:41 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895" returned: 0 in 0.625s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:41 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895 Aug 11 06:29:41 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:41 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f17d4d94-56d7-44c6-93fc-039ba02348d1" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-quobyte-f17d4d94-56d7-44c6-93fc-039ba02348d1" released by "delete_volume" :: held 1.179s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:41 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8456f678-68ec-470b-9bbc-f87324e99895" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Created reservations ['0f1e2176-4d11-4e1d-9f9f-56d39bc0b705', '4ffc1a88-30d6-4f60-824f-6131604388ab', '78575b1d-2940-43e9-afec-aea0d4e5ea79', '3872e9d2-ba69-443e-a331-425dbf1dddf0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:29:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "cinder-quobyte-8456f678-68ec-470b-9bbc-f87324e99895" released by "delete_volume" :: held 1.125s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Created reservations ['50780fda-cfa5-4cec-8968-d0862a2e0ac8', '783b2ef9-a1d4-4a1b-809a-a7194e4fe943', 'aae90326-376c-45bb-ab9e-c2dfd5590aa5', '3da6f093-7b0b-4e60-943c-a3acb562990a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:29:42 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:29:42 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:42 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:29:42 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:42 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.414s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:29:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Deleted volume successfully. Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fca8ed0b-999c-483e-9ad2-39d49e482a21 tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-f17d4d94-56d7-44c6-93fc-039ba02348d1-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:42 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.373s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:29:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Deleted volume successfully. Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-79c02c6f-8ff7-4a63-b464-017a0dcf89e7 tempest-ServerRescueNegativeTestJSON-551779162 None] Lock "cinder-8456f678-68ec-470b-9bbc-f87324e99895-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "cinder-c8e7e2c3-6222-47d6-9987-794ba6554d54-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-c8e7e2c3-6222-47d6-9987-794ba6554d54-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "cinder-quobyte-c8e7e2c3-6222-47d6-9987-794ba6554d54" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-quobyte-c8e7e2c3-6222-47d6-9987-794ba6554d54" acquired by "delete_volume" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[25485040-ff9e-47d5-a16e-a982803e138e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:43 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 Aug 11 06:29:43 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:43 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54" returned: 0 in 0.542s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:43 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54 Aug 11 06:29:43 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:44 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c8e7e2c3-6222-47d6-9987-794ba6554d54" returned: 0 in 0.513s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-quobyte-c8e7e2c3-6222-47d6-9987-794ba6554d54" released by "delete_volume" :: held 1.134s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Created reservations ['029e1f16-71df-47d4-b841-e70515132540', 'e3bf28cd-31c6-4b3f-9234-cfa94891bc5a', '3cf75048-dc04-449e-86d2-51f4da0c19e9', '7d8be2b8-2e3a-4427-93c1-c7a7865b0d66'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:29:44 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:29:44 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:29:44 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:29:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Deleted volume successfully. Aug 11 06:29:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a9e083ba-0e06-487d-844a-9046e5e4cc0a tempest-ServersNegativeTestJSON-1232393045 None] Lock "cinder-c8e7e2c3-6222-47d6-9987-794ba6554d54-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:29:54 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:29:54 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=50,cinder:SELECT=30,cinder:DELETE=5,cinder:INSERT=10 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Flow 'volume_create_manager' (bdb936c9-dda6-4b5a-8b9a-387caba03625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0178079e-9a72-4d42-8c9b-277380bac6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0178079e-9a72-4d42-8c9b-277380bac6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-677170804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb546678-d05c-4aac-a9dd-3d64c9d25034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1a0f9cdcee4d3fad28449c00285c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:08Z,use_quota=True,user_id='aace39bc8e8b4442a1daabbc2da9d3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3844370c-2301-4974-a420-9e0cfdaa30f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3844370c-2301-4974-a420-9e0cfdaa30f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b861c81-edba-406d-8fd5-66e58524daa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b861c81-edba-406d-8fd5-66e58524daa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb546678-d05c-4aac-a9dd-3d64c9d25034', 'volume_name': 'volume-eb546678-d05c-4aac-a9dd-3d64c9d25034', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1695db19-4c7d-4647-b8d3-960bbeda305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1695db19-4c7d-4647-b8d3-960bbeda305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b13b3b-f554-4791-8c10-4329f3a078a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Volume eb546678-d05c-4aac-a9dd-3d64c9d25034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb546678-d05c-4aac-a9dd-3d64c9d25034', 'volume_size': 1} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-677170804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb546678-d05c-4aac-a9dd-3d64c9d25034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1a0f9cdcee4d3fad28449c00285c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:08Z,use_quota=True,user_id='aace39bc8e8b4442a1daabbc2da9d3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Creating volume eb546678-d05c-4aac-a9dd-3d64c9d25034 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:30:08 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:30:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:08 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 1073741824 Aug 11 06:30:08 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:09 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 1073741824" returned: 0 in 0.716s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:09 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 Aug 11 06:30:09 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:09 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b13b3b-f554-4791-8c10-4329f3a078a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb546678-d05c-4aac-a9dd-3d64c9d25034', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d529a-a5cc-4f8e-9516-8990b75b82b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:09 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Volume volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 (eb546678-d05c-4aac-a9dd-3d64c9d25034): created successfully Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d529a-a5cc-4f8e-9516-8990b75b82b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Flow 'volume_create_manager' (bdb936c9-dda6-4b5a-8b9a-387caba03625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-84126a2b-6cb8-4072-9e74-92bed762338d tempest-DeleteServersTestJSON-1997429232 None] Created volume successfully. Aug 11 06:30:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6618b0e1-6d19-4b96-b6b8-a7c65e6de067 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-447666964: creating Aug 11 06:30:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6618b0e1-6d19-4b96-b6b8-a7c65e6de067 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-447666964: created successfully Aug 11 06:30:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6618b0e1-6d19-4b96-b6b8-a7c65e6de067 tempest-GroupSnapshotsTest-246045849 None] Create group completed successfully. Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (c4ad9325-5b5b-475e-846c-d861cb24dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7100fae-4597-4c4e-be3b-5cf5a0961059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7100fae-4597-4c4e-be3b-5cf5a0961059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803279377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52c5008e-cf33-43ef-b47d-4b28f3d179a7,host='devstack@QuobyteHD#QuobyteHD',id=b995bb23-11ff-494e-85cf-261bd08ff726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:12Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a540098a-8704-4e0a-bd0d-64a54f4b2af5),volume_type_id=a540098a-8704-4e0a-bd0d-64a54f4b2af5)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0aaf59-b326-43fe-a0e7-b2036227cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0aaf59-b326-43fe-a0e7-b2036227cb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceab00c-5672-4ef2-80ef-e0c2a147686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eceab00c-5672-4ef2-80ef-e0c2a147686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b995bb23-11ff-494e-85cf-261bd08ff726', 'volume_name': 'volume-b995bb23-11ff-494e-85cf-261bd08ff726', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3571ad-7d08-4892-81a0-153055fb6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3571ad-7d08-4892-81a0-153055fb6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e3e464-abc7-4bfb-a2d0-3efc200bac7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Volume b995bb23-11ff-494e-85cf-261bd08ff726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b995bb23-11ff-494e-85cf-261bd08ff726', 'volume_size': 1} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52c5008e-cf33-43ef-b47d-4b28f3d179a7,created_at=2026-08-11T04:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1803279377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52c5008e-cf33-43ef-b47d-4b28f3d179a7,host='devstack@QuobyteHD#QuobyteHD',id=b995bb23-11ff-494e-85cf-261bd08ff726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:12Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a540098a-8704-4e0a-bd0d-64a54f4b2af5),volume_type_id=a540098a-8704-4e0a-bd0d-64a54f4b2af5)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Creating volume b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:30:12 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:30:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:12 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 1073741824 Aug 11 06:30:12 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:13 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 1073741824" returned: 0 in 0.782s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:13 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:13 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:14 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.517s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e3e464-abc7-4bfb-a2d0-3efc200bac7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b995bb23-11ff-494e-85cf-261bd08ff726', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63818a85-4507-4b54-952f-4f235f126a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Volume volume-b995bb23-11ff-494e-85cf-261bd08ff726 (b995bb23-11ff-494e-85cf-261bd08ff726): created successfully Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63818a85-4507-4b54-952f-4f235f126a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (c4ad9325-5b5b-475e-846c-d861cb24dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-99293348-657b-4182-b84e-c44644908c79 tempest-GroupSnapshotsTest-246045849 None] Created volume successfully. Aug 11 06:30:14 devstack cinder-volume[94463]: WARNING py.warnings [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 11 06:30:14 devstack cinder-volume[94463]: .first() Aug 11 06:30:14 devstack cinder-volume[94463]: Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-eb546678-d05c-4aac-a9dd-3d64c9d25034', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad1f55c6-7ddf-4596-89e7-46c8b3bcf285', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:15 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:30:15 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-e5d1b435-8a98-44da-9608-7f458e350cb1 req-57dc2723-b401-459a-b81b-6e55bfc39d5f tempest-DeleteServersTestJSON-1997429232 None] attachment_update completed successfully. Aug 11 06:30:15 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.784s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:30:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] GroupSnapshot ee5b979d-718f-4241-87c7-0d3e276337e4: creating. Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Group snapshot ee5b979d-718f-4241-87c7-0d3e276337e4: creating. {{(pid=94463) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Creating offline snapshot 7c99a445-ae4f-44ce-84b6-d48b129e3424 of volume b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2581a575-6b95-4b36-a03d-ac83c6c32991]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:16 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:16 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:17 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.552s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:17 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 1G Aug 11 06:30:17 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:17 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 1G" returned: 0 in 0.587s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b995bb23-11ff-494e-85cf-261bd08ff726 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:17 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b995bb23-11ff-494e-85cf-261bd08ff726 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:17 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:18 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b995bb23-11ff-494e-85cf-261bd08ff726 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.438s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:18 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:18 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:18 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:18 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.493s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:18 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info Aug 11 06:30:18 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:19 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info" returned: 0 in 0.339s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:19 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:19 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info Aug 11 06:30:19 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:19 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.info" returned: 0 in 0.448s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-17ce3482-3c0e-4c2a-84d1-cc8e1a171081 tempest-GroupSnapshotsTest-246045849 None] group_snapshot ee5b979d-718f-4241-87c7-0d3e276337e4: created successfully Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424-2e5ceab0-eee9-4d59-9187-01c500937496" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424-2e5ceab0-eee9-4d59-9187-01c500937496" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Creating volume 2e5ceab0-eee9-4d59-9187-01c500937496 from snapshot 7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-2beb86a6-3056-4635-986f-83a44b49d02b req-ab46ea58-6a03-4314-9603-983453f18abd tempest-DeleteServersTestJSON-1997429232 None] Terminate volume connection completed successfully. Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-2beb86a6-3056-4635-986f-83a44b49d02b req-ab46ea58-6a03-4314-9603-983453f18abd tempest-DeleteServersTestJSON-1997429232 None] Deleting attachment ad1f55c6-7ddf-4596-89e7-46c8b3bcf285. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] snapshot: 7c99a445-ae4f-44ce-84b6-d48b129e3424, volume: 2e5ceab0-eee9-4d59-9187-01c500937496, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[414182bc-0f1a-4a02-8f5e-eff40d3914f3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:21 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:21 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:21 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.539s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b995bb23-11ff-494e-85cf-261bd08ff726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f894a-8901-4604-8312-a7265cbae064]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:21 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:21 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:21 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:30:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:21 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 Aug 11 06:30:21 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "cinder-eb546678-d05c-4aac-a9dd-3d64c9d25034-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "cinder-eb546678-d05c-4aac-a9dd-3d64c9d25034-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "cinder-quobyte-eb546678-d05c-4aac-a9dd-3d64c9d25034" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "cinder-quobyte-eb546678-d05c-4aac-a9dd-3d64c9d25034" acquired by "delete_volume" :: waited 0.062s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa506af-ac55-48bd-8cf4-7ee99ab432f2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:24 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 Aug 11 06:30:24 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:25 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034" returned: 0 in 1.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:25 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034 Aug 11 06:30:25 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:26 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eb546678-d05c-4aac-a9dd-3d64c9d25034" returned: 0 in 0.959s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "cinder-quobyte-eb546678-d05c-4aac-a9dd-3d64c9d25034" released by "delete_volume" :: held 2.368s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Created reservations ['74a08607-0b40-4a1c-a042-239507e204b4', '47083338-18ee-4fd4-bc93-af47d5d28069', '1b05663c-34ad-438a-a598-51b8777157cb', '0f0ad1b5-eece-4849-a24b-c34b657f9bf4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:26 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:30:26 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:27 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.711s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:30:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Deleted volume successfully. Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-319c89d1-f7c8-45ce-a409-92b14a2467ed tempest-DeleteServersTestJSON-1997429232 None] Lock "cinder-eb546678-d05c-4aac-a9dd-3d64c9d25034-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:27 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496" returned: 0 in 5.974s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:30:27 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Converted 1024.00 MB image at 171.35 MB/s Aug 11 06:30:27 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:27 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 Aug 11 06:30:27 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9cb14a5a-3689-40e9-af31-b95f886bfa6b tempest-GroupsV320Test-421394838 None] Group tempest-GroupsV320Test-Group-933220826: creating Aug 11 06:30:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9cb14a5a-3689-40e9-af31-b95f886bfa6b tempest-GroupsV320Test-421394838 None] Group tempest-GroupsV320Test-Group-933220826: created successfully Aug 11 06:30:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9cb14a5a-3689-40e9-af31-b95f886bfa6b tempest-GroupsV320Test-421394838 None] Create group completed successfully. Aug 11 06:30:28 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" released by "_copy_volume_from_snapshot" :: held 7.372s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424-2e5ceab0-eee9-4d59-9187-01c500937496" released by "_create_volume_from_snapshot" :: held 7.467s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.504s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8af7a661-8c91-4324-ad61-7bbce07a2b92 tempest-GroupSnapshotsTest-246045849 None] Create group from source-snapshot-ee5b979d-718f-4241-87c7-0d3e276337e4 completed successfully. Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Created reservations ['46c2a4de-45cc-4a20-a196-224b58ca00fc'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:29 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:30:29 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e47300f-61ea-4334-baeb-3931859c1500]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:30 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:30:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9531ab94-2e3b-4380-85d8-f79fcc5cff55 tempest-GroupsV320Test-421394838 None] Delete group completed successfully. Aug 11 06:30:30 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 Aug 11 06:30:30 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:30 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496" returned: 0 in 0.395s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:30 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496 Aug 11 06:30:30 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:30 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2e5ceab0-eee9-4d59-9187-01c500937496" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-2e5ceab0-eee9-4d59-9187-01c500937496" released by "delete_volume" :: held 0.784s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:30 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Created reservations ['f7d4f7e3-fd12-45f3-87c3-4e2903255905'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:31 devstack cinder-volume[94463]: WARNING cinder.quota [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-550763320 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-550763320, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:30:31 devstack cinder-volume[94463]: WARNING cinder.quota [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-550763320 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-550763320, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Created reservations ['c65b6bdb-7478-4d94-bc1a-8a034a1af029', 'edd5e48a-6875-4e0b-baa7-d53493231cb7', '363a7b08-5837-4574-a553-4d616c913dfb', 'e53c517c-dfba-4520-975d-d93b8f77ff8b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:31 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:30:31 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:31 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:30:31 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-467e2183-4221-463b-9756-90234c56c83b tempest-GroupSnapshotsTest-246045849 None] Delete group completed successfully. Aug 11 06:30:31 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] group_snapshot ee5b979d-718f-4241-87c7-0d3e276337e4: deleting Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] group_snapshot ee5b979d-718f-4241-87c7-0d3e276337e4: deleting {{(pid=94463) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Deleting offline snapshot 7c99a445-ae4f-44ce-84b6-d48b129e3424 of volume b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] snapshot_file for this snap is: volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a9117-a81e-44df-b7f4-15d06c7dcd26]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:31 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:31 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:32 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.620s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b995bb23-11ff-494e-85cf-261bd08ff726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:30:32 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9e4207-81ca-462b-a0e2-d9f58c9c5d38]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:32 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:32 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:33 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.693s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:33 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:33 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:33 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.607s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:33 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424 Aug 11 06:30:33 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:34 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726.7c99a445-ae4f-44ce-84b6-d48b129e3424" returned: 0 in 0.331s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-7c99a445-ae4f-44ce-84b6-d48b129e3424" released by "_delete_snapshot" :: held 2.412s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" released by "delete_snapshot" :: held 2.458s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:34 devstack cinder-volume[94463]: WARNING cinder.quota [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-550763320 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-550763320, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:30:34 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] Created reservations ['815beed7-4e64-4b6b-b383-41f9b3f8d23f', 'fe766a36-ebd1-48c8-bbb7-650ed645f3de', 'adedce76-468b-41a3-a251-56bfe16b5259', '1c386a02-f074-41b1-bf9c-0da409ca30c0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-82419aa0-49d7-4715-ab93-f6efd5d0360e tempest-GroupSnapshotsTest-246045849 None] group_snapshot ee5b979d-718f-4241-87c7-0d3e276337e4: deleted successfully Aug 11 06:30:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a50d0-53c2-4523-b0b7-2485b2e442f4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:35 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:35 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:36 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.487s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:36 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726 Aug 11 06:30:36 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:36 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b995bb23-11ff-494e-85cf-261bd08ff726" returned: 0 in 0.331s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-b995bb23-11ff-494e-85cf-261bd08ff726" released by "delete_volume" :: held 0.950s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['37fd0187-ed5e-4d98-a2c0-67c10457c3c8'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:36 devstack cinder-volume[94463]: WARNING cinder.db.api [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-550763320'] Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['f304c266-6de6-4f2e-94f3-7b85ed17008f', '6adbe02a-6cae-4282-8d14-9e36494d217c', '53275d89-6516-496f-8ba7-e91c4baac18f', '037c1d28-775d-4158-aefb-11b6beef28a2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:36 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:30:36 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:37 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.728s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:37 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:30:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-34f49018-ddb6-4210-919e-c92c3893ad42 tempest-GroupSnapshotsTest-246045849 None] Delete group completed successfully. Aug 11 06:30:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6abaf730-9b6f-4665-a3ba-7ec3fa0c2bc9 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-90381603: creating Aug 11 06:30:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6abaf730-9b6f-4665-a3ba-7ec3fa0c2bc9 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-90381603: created successfully Aug 11 06:30:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6abaf730-9b6f-4665-a3ba-7ec3fa0c2bc9 tempest-GroupSnapshotsTest-246045849 None] Create group completed successfully. Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (e9832a92-ff9c-41c8-babe-8f2911863cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d33af-6175-43a2-b5ad-718278e00d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d33af-6175-43a2-b5ad-718278e00d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-729622590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,host='devstack@QuobyteHD#QuobyteHD',id=a4c10596-b41d-42f6-98e5-04329c319864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:40Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc588deb-5a1a-4530-b1b9-a675dc4d59bc),volume_type_id=cc588deb-5a1a-4530-b1b9-a675dc4d59bc)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4bf64-91de-4dbb-a9ba-2495816f6a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4bf64-91de-4dbb-a9ba-2495816f6a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658854b-a98e-4888-b3eb-286511213355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658854b-a98e-4888-b3eb-286511213355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c10596-b41d-42f6-98e5-04329c319864', 'volume_name': 'volume-a4c10596-b41d-42f6-98e5-04329c319864', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76db0876-99b3-486a-8878-739a46a00843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76db0876-99b3-486a-8878-739a46a00843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddfa81c-9f9f-4b59-ae53-e6a28518d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Volume a4c10596-b41d-42f6-98e5-04329c319864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c10596-b41d-42f6-98e5-04329c319864', 'volume_size': 1} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,created_at=2026-08-11T04:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-729622590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,host='devstack@QuobyteHD#QuobyteHD',id=a4c10596-b41d-42f6-98e5-04329c319864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:40Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc588deb-5a1a-4530-b1b9-a675dc4d59bc),volume_type_id=cc588deb-5a1a-4530-b1b9-a675dc4d59bc)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Creating volume a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:30:39 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:30:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:39 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 1073741824 Aug 11 06:30:39 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:40 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 1073741824" returned: 0 in 0.843s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:40 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 Aug 11 06:30:40 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:41 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864" returned: 0 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddfa81c-9f9f-4b59-ae53-e6a28518d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c10596-b41d-42f6-98e5-04329c319864', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8abf0a8-27dc-41ec-9712-94146c22e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Volume volume-a4c10596-b41d-42f6-98e5-04329c319864 (a4c10596-b41d-42f6-98e5-04329c319864): created successfully Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8abf0a8-27dc-41ec-9712-94146c22e59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (e9832a92-ff9c-41c8-babe-8f2911863cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dab1967b-e4bc-4f6b-a7dd-18e1130d7856 tempest-GroupSnapshotsTest-246045849 None] Created volume successfully. Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (ac5ee348-6e13-49ce-a3e7-6acc1ea6687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5142f0b-2212-47db-8867-da12fc577d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5142f0b-2212-47db-8867-da12fc577d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648613077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,host='devstack@QuobyteHD#QuobyteHD',id=86d392e3-a04c-4ee1-b8a8-8a2431656e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:43Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc588deb-5a1a-4530-b1b9-a675dc4d59bc),volume_type_id=cc588deb-5a1a-4530-b1b9-a675dc4d59bc)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c23f26e-34fb-4527-bb2b-074881029233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c23f26e-34fb-4527-bb2b-074881029233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89c572-05f3-4c46-8578-04b8295d4300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a89c572-05f3-4c46-8578-04b8295d4300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d392e3-a04c-4ee1-b8a8-8a2431656e99', 'volume_name': 'volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe0d44-46c3-4832-b18f-98d7983c64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fe0d44-46c3-4832-b18f-98d7983c64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634e7d6-a46c-4d58-9d7b-de0c381d6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:43 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Volume 86d392e3-a04c-4ee1-b8a8-8a2431656e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99', 'volume_size': 1} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,created_at=2026-08-11T04:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648613077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c51d91c0-a04e-4f85-8f75-f5221bf2428c,host='devstack@QuobyteHD#QuobyteHD',id=86d392e3-a04c-4ee1-b8a8-8a2431656e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:30:43Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc588deb-5a1a-4530-b1b9-a675dc4d59bc),volume_type_id=cc588deb-5a1a-4530-b1b9-a675dc4d59bc)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Creating volume 86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:30:43 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:30:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:43 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 1073741824 Aug 11 06:30:43 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:44 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 1073741824" returned: 0 in 0.534s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:44 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 Aug 11 06:30:44 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:44 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99" returned: 0 in 0.472s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634e7d6-a46c-4d58-9d7b-de0c381d6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106bd239-674b-4ec9-9ace-4290458919ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:30:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Volume volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 (86d392e3-a04c-4ee1-b8a8-8a2431656e99): created successfully Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106bd239-674b-4ec9-9ace-4290458919ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:30:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (ac5ee348-6e13-49ce-a3e7-6acc1ea6687b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:30:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-cc59c3d0-fc06-4149-8daa-c40e0e7df406 tempest-GroupSnapshotsTest-246045849 None] Created volume successfully. Aug 11 06:30:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-65b53c6a-8c6f-4f63-baa7-951c8bce28db tempest-GroupSnapshotsTest-246045849 None] Update group completed successfully. Aug 11 06:30:47 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0d0aec79-3eef-44d4-a735-2f3313b39426 tempest-GroupSnapshotsTest-246045849 None] Update group completed successfully. Aug 11 06:30:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-abd66846-3dce-4692-ad05-5f4de5941b61 tempest-GroupSnapshotsTest-246045849 None] Update group completed successfully. Aug 11 06:30:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-573e5855-b007-484e-abf6-4a400e8ac3c8 tempest-GroupSnapshotsTest-246045849 None] Update group completed successfully. Aug 11 06:30:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] GroupSnapshot 48ceff80-7196-4a48-ba34-f07bb4957824: creating. Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Group snapshot 48ceff80-7196-4a48-ba34-f07bb4957824: creating. {{(pid=94463) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Creating offline snapshot 3172c013-fd30-433d-b9c3-6239990a4943 of volume 86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e34b7b-094e-4417-a95f-fd9d212881f6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:52 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 Aug 11 06:30:52 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:52 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99" returned: 0 in 0.448s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:52 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 1G Aug 11 06:30:52 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:53 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 1G" returned: 0 in 0.470s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:53 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 Aug 11 06:30:53 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:53 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943" returned: 0 in 0.355s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:53 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:53 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 Aug 11 06:30:53 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:53 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:53 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info Aug 11 06:30:53 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:54 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:54 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:54 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info Aug 11 06:30:54 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:54 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.info" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Creating offline snapshot 4bef4c55-c16a-4aa4-a84e-414ca37027b7 of volume a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ba277d-6678-44c5-b6c6-0a6831f0eed3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:54 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 Aug 11 06:30:54 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:54 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864" returned: 0 in 0.361s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:54 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 1G Aug 11 06:30:54 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:55 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 1G" returned: 0 in 0.561s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c10596-b41d-42f6-98e5-04329c319864 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:55 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c10596-b41d-42f6-98e5-04329c319864 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 Aug 11 06:30:55 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:55 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c10596-b41d-42f6-98e5-04329c319864 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7" returned: 0 in 0.325s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:55 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:55 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 Aug 11 06:30:55 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:56 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:56 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info Aug 11 06:30:56 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:56 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:56 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:56 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info Aug 11 06:30:56 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:56 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.info" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:30:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0578dba0-087d-47aa-bafd-6a554d516d50 tempest-GroupSnapshotsTest-246045849 None] group_snapshot 48ceff80-7196-4a48-ba34-f07bb4957824: created successfully Aug 11 06:30:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] group_snapshot 48ceff80-7196-4a48-ba34-f07bb4957824: deleting Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] group_snapshot 48ceff80-7196-4a48-ba34-f07bb4957824: deleting {{(pid=94463) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-3172c013-fd30-433d-b9c3-6239990a4943" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-3172c013-fd30-433d-b9c3-6239990a4943" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Deleting offline snapshot 3172c013-fd30-433d-b9c3-6239990a4943 of volume 86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] snapshot_file for this snap is: volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80eefab-762d-449f-93aa-e5cadea0d7d3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:58 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 Aug 11 06:30:58 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:58 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943" returned: 0 in 0.492s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b133df3-cb0a-4071-9857-d41974bbae8a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:58 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 Aug 11 06:30:58 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:58 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:58 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 Aug 11 06:30:58 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:59 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943" returned: 0 in 0.460s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:30:59 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943 Aug 11 06:30:59 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:30:59 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99.3172c013-fd30-433d-b9c3-6239990a4943" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-3172c013-fd30-433d-b9c3-6239990a4943" released by "_delete_snapshot" :: held 1.810s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" released by "delete_snapshot" :: held 1.841s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-4bef4c55-c16a-4aa4-a84e-414ca37027b7" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-4bef4c55-c16a-4aa4-a84e-414ca37027b7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Deleting offline snapshot 4bef4c55-c16a-4aa4-a84e-414ca37027b7 of volume a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] snapshot_file for this snap is: volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[33665cd3-11b2-4f63-8a73-3bc5bd661511]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:30:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:00 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 Aug 11 06:31:00 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:00 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7" returned: 0 in 0.455s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c10596-b41d-42f6-98e5-04329c319864(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a50bd-200a-4d2c-86d5-2cb7f58975ae]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:00 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 Aug 11 06:31:00 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:00 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864" returned: 0 in 0.528s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:00 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 Aug 11 06:31:00 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:01 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7" returned: 0 in 0.609s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:01 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7 Aug 11 06:31:01 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:01 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864.4bef4c55-c16a-4aa4-a84e-414ca37027b7" returned: 0 in 0.453s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-4bef4c55-c16a-4aa4-a84e-414ca37027b7" released by "_delete_snapshot" :: held 2.234s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" released by "delete_snapshot" :: held 2.267s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:02 devstack cinder-volume[94463]: WARNING cinder.quota [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-282274252 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-282274252, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:02 devstack cinder-volume[94463]: WARNING cinder.quota [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-282274252 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-282274252, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:02 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Created reservations ['6b70563f-2102-4b6b-98e0-01ab130aaf32', '3645010b-d15b-47d4-a2be-6e838e6105c5', '9fc37943-80f9-4d4a-a076-2efd9ed45672', 'f1b56eaf-cc78-4b06-bd8a-7a7e6759bb77'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:02 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] Created reservations ['c03ccfcd-370a-4172-9db9-284d71064fb6', 'b6232d22-04c2-4ae2-be65-46ea606be68e', '1a769cc4-5202-4b20-b0c9-d12c5889ff59', '458abb2a-48d0-4653-8d9c-15db797f51ac'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:02 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-441b9592-43f2-44fa-a636-7bae078d80ce tempest-GroupSnapshotsTest-246045849 None] group_snapshot 48ceff80-7196-4a48-ba34-f07bb4957824: deleted successfully Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02eb96e-0214-48d3-a518-2831c1254f8b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:03 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 Aug 11 06:31:03 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:03 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99" returned: 0 in 0.560s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:03 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99 Aug 11 06:31:03 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:04 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-86d392e3-a04c-4ee1-b8a8-8a2431656e99" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-86d392e3-a04c-4ee1-b8a8-8a2431656e99" released by "delete_volume" :: held 0.927s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9c3e3-1ab3-42e1-9871-30b6d6fa1415]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:04 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 Aug 11 06:31:04 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:04 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864" returned: 0 in 0.475s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:04 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864 Aug 11 06:31:04 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:05 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a4c10596-b41d-42f6-98e5-04329c319864" returned: 0 in 0.403s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-a4c10596-b41d-42f6-98e5-04329c319864" released by "delete_volume" :: held 0.960s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=92,cinder:UPDATE=88,cinder:INSERT=17,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=70,cinder:SELECT=97,cinder:INSERT=18,cinder:DELETE=4 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['72d9269a-8f30-4b92-bed6-ca44b05ce92f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:05 devstack cinder-volume[94463]: WARNING cinder.quota [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-282274252 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-282274252, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['504bbc70-fe4a-4650-a58e-0b91fae15c8e', 'f6081725-65c3-454b-bb48-7669a72ac697', '92538424-06ae-4fcf-847e-1639804b2319', '70174905-3210-4255-939d-a762d43ae74e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['d824d80a-00b8-4264-82a8-82e2201878b0', 'dd3e83d2-4376-4c0b-8c64-093bc3809454', 'f911a1ce-b1c2-48f8-aea4-966037ae0531', 'fd6707fe-e343-4b1b-934e-ae874f68b205'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Flow 'volume_create_manager' (95a44d21-cf23-4365-813e-8c9e8e953eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f02b0ae-dc9f-4f9b-beb2-7efe7fbf287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f02b0ae-dc9f-4f9b-beb2-7efe7fbf287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1889210933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0121db57-42b5-4a51-84da-8ce9731f9af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f5028d3da4e65a762dbcc69575d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:06Z,use_quota=True,user_id='f251a3d9fc9e4e52867d15d4db44b05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfc2f87-2c98-4ae4-8ace-9ec0f334c84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfc2f87-2c98-4ae4-8ace-9ec0f334c84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea534c6-2e3c-4c79-b503-59d945823635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea534c6-2e3c-4c79-b503-59d945823635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0121db57-42b5-4a51-84da-8ce9731f9af7', 'volume_name': 'volume-0121db57-42b5-4a51-84da-8ce9731f9af7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a6a58-898b-4f03-9715-9f521deeaa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a6a58-898b-4f03-9715-9f521deeaa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88e86a2-410a-4ad0-9016-e00e45007f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:05 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Volume 0121db57-42b5-4a51-84da-8ce9731f9af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0121db57-42b5-4a51-84da-8ce9731f9af7', 'volume_size': 1} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1889210933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0121db57-42b5-4a51-84da-8ce9731f9af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f5028d3da4e65a762dbcc69575d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:06Z,use_quota=True,user_id='f251a3d9fc9e4e52867d15d4db44b05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Creating volume 0121db57-42b5-4a51-84da-8ce9731f9af7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:05 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:05 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 1073741824 Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:05 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:05 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:05 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:06 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.376s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3f021f8e-6ee6-40c5-8519-73872337f748 tempest-GroupSnapshotsTest-246045849 None] Delete group completed successfully. Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Flow 'volume_create_manager' (1c6fb340-7e7e-4c2a-b3ed-f69ad082afad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ebd8b-6798-4f9e-90ea-380400ab95a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ebd8b-6798-4f9e-90ea-380400ab95a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1867465194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb8d486-97c7-4f01-a212-df672d3133f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ed84166f25455bbcdc34ed8ba734de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:06Z,use_quota=True,user_id='4363f0fd16e8480799568d9914a925c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6383b7-5a36-4f0c-b0fc-85f325093223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6383b7-5a36-4f0c-b0fc-85f325093223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a08fb6b-80c6-4753-8faf-5aa5a8bbc3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a08fb6b-80c6-4753-8faf-5aa5a8bbc3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb8d486-97c7-4f01-a212-df672d3133f5', 'volume_name': 'volume-7bb8d486-97c7-4f01-a212-df672d3133f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede79098-0117-42f4-aa68-15fa9c7adecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede79098-0117-42f4-aa68-15fa9c7adecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0059fb-9de1-4ffb-b072-e18b23aeed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Volume 7bb8d486-97c7-4f01-a212-df672d3133f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb8d486-97c7-4f01-a212-df672d3133f5', 'volume_size': 1} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:06 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 1073741824" returned: 0 in 0.696s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:06 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 Aug 11 06:31:06 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:06 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1867465194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb8d486-97c7-4f01-a212-df672d3133f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36ed84166f25455bbcdc34ed8ba734de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:06Z,use_quota=True,user_id='4363f0fd16e8480799568d9914a925c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Creating volume 7bb8d486-97c7-4f01-a212-df672d3133f5 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:06 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f88e86a2-410a-4ad0-9016-e00e45007f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0121db57-42b5-4a51-84da-8ce9731f9af7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:06 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 1073741824 Aug 11 06:31:06 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7936b5a-4736-488e-b9a7-e8784b7854d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Volume volume-0121db57-42b5-4a51-84da-8ce9731f9af7 (0121db57-42b5-4a51-84da-8ce9731f9af7): created successfully Aug 11 06:31:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7936b5a-4736-488e-b9a7-e8784b7854d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Flow 'volume_create_manager' (95a44d21-cf23-4365-813e-8c9e8e953eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-716d074c-f3fe-4543-b775-cb2edac25923 tempest-ServerActionsTestOtherA-1490261714 None] Created volume successfully. Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8bd9c7ab-b0ba-4445-a510-45cbdf8c0508 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-1627313397: creating Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8bd9c7ab-b0ba-4445-a510-45cbdf8c0508 tempest-GroupSnapshotsTest-246045849 None] Group tempest-GroupSnapshotsTest-Group-1627313397: created successfully Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8bd9c7ab-b0ba-4445-a510-45cbdf8c0508 tempest-GroupSnapshotsTest-246045849 None] Create group completed successfully. Aug 11 06:31:07 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 1073741824" returned: 0 in 0.621s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:07 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 Aug 11 06:31:07 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:07 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0059fb-9de1-4ffb-b072-e18b23aeed7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb8d486-97c7-4f01-a212-df672d3133f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995e17b2-43d9-4642-b588-2c2dadc97d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Volume volume-7bb8d486-97c7-4f01-a212-df672d3133f5 (7bb8d486-97c7-4f01-a212-df672d3133f5): created successfully Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995e17b2-43d9-4642-b588-2c2dadc97d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Flow 'volume_create_manager' (1c6fb340-7e7e-4c2a-b3ed-f69ad082afad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dd6f0688-1a44-489e-af13-97238c8629cd tempest-TaggedAttachmentsTest-1186048019 None] Created volume successfully. Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (5d758a3b-08bb-4201-a2e5-97df817a279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e945c73-508a-4dc1-8a30-bcb91b1458cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e945c73-508a-4dc1-8a30-bcb91b1458cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336220451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12dad7bc-0259-497d-99a9-16b7b64ba9cb,host='devstack@QuobyteHD#QuobyteHD',id=34ce1d79-0ea0-4e81-9033-2b3bc4b9953b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:09Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba13d53b-ee0d-4573-8031-1f69bf5dfb94),volume_type_id=ba13d53b-ee0d-4573-8031-1f69bf5dfb94)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49f22c1-ae64-422d-9955-b3fab2344493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49f22c1-ae64-422d-9955-b3fab2344493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b1d737-c445-454c-8f6a-e9053c7a3273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b1d737-c445-454c-8f6a-e9053c7a3273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ce1d79-0ea0-4e81-9033-2b3bc4b9953b', 'volume_name': 'volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad79bf-325f-4443-8a50-8c12dca40199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ad79bf-325f-4443-8a50-8c12dca40199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55c7e1a-ffff-4d7a-8396-5ac9cf033dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:09 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Volume 34ce1d79-0ea0-4e81-9033-2b3bc4b9953b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b', 'volume_size': 1} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12dad7bc-0259-497d-99a9-16b7b64ba9cb,created_at=2026-08-11T04:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1336220451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12dad7bc-0259-497d-99a9-16b7b64ba9cb,host='devstack@QuobyteHD#QuobyteHD',id=34ce1d79-0ea0-4e81-9033-2b3bc4b9953b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adf58c098c34a0b8a60dbd75e0237a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:09Z,use_quota=True,user_id='8ed303ba690b4128a13e807f3f46171a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba13d53b-ee0d-4573-8031-1f69bf5dfb94),volume_type_id=ba13d53b-ee0d-4573-8031-1f69bf5dfb94)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Creating volume 34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:09 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:09 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b 1073741824 Aug 11 06:31:09 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:09 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b 1073741824" returned: 0 in 0.556s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:09 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b Aug 11 06:31:09 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:10 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" returned: 0 in 0.330s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55c7e1a-ffff-4d7a-8396-5ac9cf033dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91139a16-18d6-415c-84b4-cda1fdb56710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:10 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Volume volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b (34ce1d79-0ea0-4e81-9033-2b3bc4b9953b): created successfully Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91139a16-18d6-415c-84b4-cda1fdb56710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Flow 'volume_create_manager' (5d758a3b-08bb-4201-a2e5-97df817a279f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c161fba7-15e6-40cc-af99-e442d038ecad tempest-GroupSnapshotsTest-246045849 None] Created volume successfully. Aug 11 06:31:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] GroupSnapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: creating. Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Group snapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: creating. {{(pid=94463) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Creating offline snapshot 6fd7697c-fc07-47db-a83c-9cc8ab557812 of volume 34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c64024-62db-4143-a4d5-ce3771ed92ea]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:12 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b Aug 11 06:31:12 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:12 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" returned: 0 in 0.760s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:13 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 1G Aug 11 06:31:13 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:13 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 1G" returned: 0 in 0.526s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:13 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 Aug 11 06:31:13 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:13 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:13 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:31:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:13 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 Aug 11 06:31:13 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:14 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812" returned: 0 in 0.330s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:14 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info Aug 11 06:31:14 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:14 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:14 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:31:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:14 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info Aug 11 06:31:14 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:15 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.info" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:15 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:15 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-51578be1-a12c-43ff-8fa2-449da48e309b tempest-GroupSnapshotsTest-246045849 None] group_snapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: created successfully Aug 11 06:31:15 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.400s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 8 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:31:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] group_snapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: deleting Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] group_snapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: deleting {{(pid=94463) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-6fd7697c-fc07-47db-a83c-9cc8ab557812" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-6fd7697c-fc07-47db-a83c-9cc8ab557812" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Deleting offline snapshot 6fd7697c-fc07-47db-a83c-9cc8ab557812 of volume 34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] snapshot_file for this snap is: volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006bb56-0b76-48c3-bb4f-2f5eccde8334]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:16 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 Aug 11 06:31:16 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:16 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a385e-c25b-4af1-aabe-10ae3b91a19f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:16 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b Aug 11 06:31:16 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:16 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" returned: 0 in 0.418s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:16 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 Aug 11 06:31:16 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:17 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812" returned: 0 in 0.428s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:17 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812 Aug 11 06:31:17 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:17 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b.6fd7697c-fc07-47db-a83c-9cc8ab557812" returned: 0 in 0.573s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-6fd7697c-fc07-47db-a83c-9cc8ab557812" released by "_delete_snapshot" :: held 2.015s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" released by "delete_snapshot" :: held 2.043s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:17 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-606660879 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-606660879, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:17 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-606660879 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-606660879, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] Created reservations ['5fc5b97b-5406-4d28-b0da-093c6e4e76b2', '03bd16ae-c450-4f2d-bc1a-b1f56ae5a1f8', '02d8505e-4fd0-4dca-be90-664c08b93f80', '4bbfce95-4206-4c57-a2a6-2e63865f520e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1ccd146e-a842-431b-b0a3-c8fd2872c7ee tempest-GroupSnapshotsTest-246045849 None] group_snapshot b20e8d8f-4696-4381-9fee-3663b48f0e26: deleted successfully Aug 11 06:31:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf957b8-425d-448d-a00f-f5db2991746d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:20 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b Aug 11 06:31:20 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:21 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" returned: 0 in 0.982s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:21 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b Aug 11 06:31:21 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:21 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" returned: 0 in 0.531s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Lock "cinder-quobyte-34ce1d79-0ea0-4e81-9033-2b3bc4b9953b" released by "delete_volume" :: held 1.707s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['8f95d72b-5302-46fe-99ed-2f527416c84c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:22 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-606660879 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-606660879, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Created reservations ['fd22f435-631f-4975-a7b5-e6a131bc634c', '60b3e2fb-8aae-4c05-b549-8f248c853275', 'd7ad5cdc-01c9-49c3-947b-81c570b9e1a4', '510da88b-8a87-4337-9225-2196bf053dc4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:22 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:22 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:22 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1c737b74-b189-4917-b1c2-2a4b20111b51 tempest-GroupSnapshotsTest-246045849 None] Delete group completed successfully. Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (63991fec-be20-4f34-8c95-4b6363d71f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e31fa-ba02-42d6-ad67-630d39839293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9e31fa-ba02-42d6-ad67-630d39839293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004297343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab246c1a-a537-4318-ba3d-56c45d85c577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:25Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdc9f0c-802f-4e6e-8b7a-6c20600da034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdc9f0c-802f-4e6e-8b7a-6c20600da034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5264495f-2d82-4279-9eb2-1ed3d0fbca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5264495f-2d82-4279-9eb2-1ed3d0fbca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab246c1a-a537-4318-ba3d-56c45d85c577', 'volume_name': 'volume-ab246c1a-a537-4318-ba3d-56c45d85c577', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a6c39-26b9-41a9-9e83-b70110f84543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a6c39-26b9-41a9-9e83-b70110f84543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0f6f2c-c1bf-4371-bee3-a250f01a9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Volume ab246c1a-a537-4318-ba3d-56c45d85c577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab246c1a-a537-4318-ba3d-56c45d85c577', 'volume_size': 1} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004297343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab246c1a-a537-4318-ba3d-56c45d85c577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:25Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Creating volume ab246c1a-a537-4318-ba3d-56c45d85c577 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:25 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:25 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 1073741824 Aug 11 06:31:25 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:26 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 1073741824" returned: 0 in 0.865s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:26 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 Aug 11 06:31:26 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:26 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577" returned: 0 in 0.479s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0f6f2c-c1bf-4371-bee3-a250f01a9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab246c1a-a537-4318-ba3d-56c45d85c577', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c05bc21-0dd2-4c98-b0b9-df055451c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Volume volume-ab246c1a-a537-4318-ba3d-56c45d85c577 (ab246c1a-a537-4318-ba3d-56c45d85c577): created successfully Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c05bc21-0dd2-4c98-b0b9-df055451c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (63991fec-be20-4f34-8c95-4b6363d71f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0a19cd18-f57e-412e-a0f0-9ea66247fb7c tempest-VolumesListAdminTestJSON-1420760892 None] Created volume successfully. Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (19ee5a1d-1c54-4a54-a2a5-a2fe051c12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4691d819-3349-4a0f-a59f-119384c737a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4691d819-3349-4a0f-a59f-119384c737a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-948829602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f2ffe3-4321-4270-bbdf-5ef15e9766e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:28Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70068d4b-2e79-41cf-b9c8-8f9d435827a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70068d4b-2e79-41cf-b9c8-8f9d435827a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bede9c-6d76-463b-af62-5927fc1c0806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bede9c-6d76-463b-af62-5927fc1c0806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f2ffe3-4321-4270-bbdf-5ef15e9766e3', 'volume_name': 'volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e167d4d4-af98-419d-a738-adc140996c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e167d4d4-af98-419d-a738-adc140996c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c866a10d-a045-40cf-b8ad-794e23e32d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Volume 61f2ffe3-4321-4270-bbdf-5ef15e9766e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3', 'volume_size': 1} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-948829602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f2ffe3-4321-4270-bbdf-5ef15e9766e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:28Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Creating volume 61f2ffe3-4321-4270-bbdf-5ef15e9766e3 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:28 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:28 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 1073741824 Aug 11 06:31:28 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:29 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 1073741824" returned: 0 in 0.701s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:29 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 Aug 11 06:31:29 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:29 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" returned: 0 in 0.299s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c866a10d-a045-40cf-b8ad-794e23e32d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b8b4ef-01dc-4817-8f2f-47d0d2a1cf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:29 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Volume volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 (61f2ffe3-4321-4270-bbdf-5ef15e9766e3): created successfully Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b8b4ef-01dc-4817-8f2f-47d0d2a1cf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (19ee5a1d-1c54-4a54-a2a5-a2fe051c12be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-474135d4-1f92-4855-b0d6-935cfdd2ef25 tempest-VolumesListAdminTestJSON-1420760892 None] Created volume successfully. Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (42691a6f-451d-4b0e-bb2d-dbca681c6be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419222e1-4110-498b-ac4d-94140ebed9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419222e1-4110-498b-ac4d-94140ebed9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-572966257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b213a-3551-4851-a662-10fb36bbd646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:31Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5799025-5d91-422f-b986-c66cd321e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5799025-5d91-422f-b986-c66cd321e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2ab49c-de2b-4834-93e2-dff1cd27fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2ab49c-de2b-4834-93e2-dff1cd27fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843b213a-3551-4851-a662-10fb36bbd646', 'volume_name': 'volume-843b213a-3551-4851-a662-10fb36bbd646', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d11bb5a-c058-4697-b5d4-1beb720915a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d11bb5a-c058-4697-b5d4-1beb720915a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2812c9-21ff-4483-986d-91acb33a6370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Volume 843b213a-3551-4851-a662-10fb36bbd646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843b213a-3551-4851-a662-10fb36bbd646', 'volume_size': 1} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-572966257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843b213a-3551-4851-a662-10fb36bbd646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f703dd73a43445a909615db5bd18e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:31Z,use_quota=True,user_id='f6aa083ed5d64a4784b872b75e5ad87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Creating volume 843b213a-3551-4851-a662-10fb36bbd646 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:31 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:31 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 1073741824 Aug 11 06:31:31 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:31 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 1073741824" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:31 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 Aug 11 06:31:31 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:32 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2812c9-21ff-4483-986d-91acb33a6370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843b213a-3551-4851-a662-10fb36bbd646', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2c65e0-be37-47dc-818b-5a3951724f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Volume volume-843b213a-3551-4851-a662-10fb36bbd646 (843b213a-3551-4851-a662-10fb36bbd646): created successfully Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2c65e0-be37-47dc-818b-5a3951724f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Flow 'volume_create_manager' (42691a6f-451d-4b0e-bb2d-dbca681c6be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8f132206-7ffe-4aee-9929-47a00d972558 tempest-VolumesListAdminTestJSON-1420760892 None] Created volume successfully. Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Flow 'volume_create_manager' (cad4d477-2f1d-4a2c-b843-fcc0f2acfd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f222c8-ff6a-4980-bd97-a856a2915013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f222c8-ff6a-4980-bd97-a856a2915013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8dfbdc-41ad-4cfa-9675-b8093e9679c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229e07674ccc49af8f61637bc38e6c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:34Z,use_quota=True,user_id='6dffb3dc853c446ab6e7caf255ba6bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbca43-c36f-4b8a-ac7a-518a3f5dfbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbca43-c36f-4b8a-ac7a-518a3f5dfbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760feef6-47be-4c1c-9fdb-ba190989e2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760feef6-47be-4c1c-9fdb-ba190989e2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8dfbdc-41ad-4cfa-9675-b8093e9679c3', 'volume_name': 'volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d08108-5d59-487d-986f-082b9d593430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d08108-5d59-487d-986f-082b9d593430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d171d14-3b93-4e0f-8961-6ecb9a2bff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:34 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Volume dd8dfbdc-41ad-4cfa-9675-b8093e9679c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3', 'volume_size': 1} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8dfbdc-41ad-4cfa-9675-b8093e9679c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='229e07674ccc49af8f61637bc38e6c52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:34Z,use_quota=True,user_id='6dffb3dc853c446ab6e7caf255ba6bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Creating volume dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:34 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:34 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 1073741824 Aug 11 06:31:34 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:34 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 1073741824" returned: 0 in 0.524s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:35 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 Aug 11 06:31:35 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:35 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d171d14-3b93-4e0f-8961-6ecb9a2bff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ad2479-014f-4bbe-83da-ee4a8ab94143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:35 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Volume volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 (dd8dfbdc-41ad-4cfa-9675-b8093e9679c3): created successfully Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ad2479-014f-4bbe-83da-ee4a8ab94143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Flow 'volume_create_manager' (cad4d477-2f1d-4a2c-b843-fcc0f2acfd0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d2783cae-7af7-496a-b043-a18b25bbedae tempest-VolumesListAdminTestJSON-583778007 None] Created volume successfully. Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Acquiring lock "cinder-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "cinder-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Acquiring lock "cinder-quobyte-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "cinder-quobyte-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" acquired by "delete_volume" :: waited 0.050s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-843b213a-3551-4851-a662-10fb36bbd646-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825833e-2ceb-4654-a9b5-f93d60303d3c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-843b213a-3551-4851-a662-10fb36bbd646-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-quobyte-843b213a-3551-4851-a662-10fb36bbd646" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-843b213a-3551-4851-a662-10fb36bbd646" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a13461-fc88-46d6-b087-906364a187aa]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:37 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 Aug 11 06:31:37 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:37 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 Aug 11 06:31:37 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:37 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" returned: 0 in 0.583s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:37 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3 Aug 11 06:31:37 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:37 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646" returned: 0 in 0.508s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:37 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646 Aug 11 06:31:37 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:37 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" returned: 0 in 0.337s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "cinder-quobyte-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3" released by "delete_volume" :: held 1.012s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Created reservations ['9a8910ee-fb4d-43a5-8224-131e4d3dcfaa', '1f165371-9919-40b1-b158-c2c783a83458', 'af2d2032-25c9-4046-8bdd-fee8036ebe9a', 'e8fdeaf4-35f6-4420-b09f-6912ccd1aaa9'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:37 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-843b213a-3551-4851-a662-10fb36bbd646" returned: 0 in 0.442s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-843b213a-3551-4851-a662-10fb36bbd646" released by "delete_volume" :: held 1.037s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:38 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:38 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Created reservations ['dbe4db20-56ad-44e8-89ea-315926b11d12', '4d2008d8-2d4b-47da-a416-431257f8d2c7', 'c1e9a158-0c41-4ab5-8fc6-919aea83b9d3', '65cd2ca3-7d03-4ed0-bf91-fafc09367be2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:38 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:38 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:38 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.354s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Deleted volume successfully. Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7b2e64bc-a2e5-45f1-8615-2cba5a54f559 tempest-VolumesListAdminTestJSON-583778007 None] Lock "cinder-dd8dfbdc-41ad-4cfa-9675-b8093e9679c3-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:38 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Deleted volume successfully. Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3bc636bd-292e-4eda-8675-8340693d6eed tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-843b213a-3551-4851-a662-10fb36bbd646-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Flow 'volume_create_manager' (c86ef842-4f70-4e96-b2b6-0385dccc810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa282d39-6b19-41d2-b2ea-fa329ec615c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa282d39-6b19-41d2-b2ea-fa329ec615c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1030696452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4dfd03-b9ba-4809-8193-50262d1ae694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba331aae9034a2b8af311fcc9f4a375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:39Z,use_quota=True,user_id='ab913a996b0a4df7b039d60214052404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39244e16-eaad-4f32-bc3f-5e511895bfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39244e16-eaad-4f32-bc3f-5e511895bfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f255a1-73fb-49c3-a808-65ee0fb1f472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f255a1-73fb-49c3-a808-65ee0fb1f472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4dfd03-b9ba-4809-8193-50262d1ae694', 'volume_name': 'volume-bb4dfd03-b9ba-4809-8193-50262d1ae694', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4adc9e-89c1-4514-b611-286b84776ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4adc9e-89c1-4514-b611-286b84776ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb76a16c-2364-44a3-90d9-e0fd61b02e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:38 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Volume bb4dfd03-b9ba-4809-8193-50262d1ae694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4dfd03-b9ba-4809-8193-50262d1ae694', 'volume_size': 1} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1030696452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4dfd03-b9ba-4809-8193-50262d1ae694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba331aae9034a2b8af311fcc9f4a375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:39Z,use_quota=True,user_id='ab913a996b0a4df7b039d60214052404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Creating volume bb4dfd03-b9ba-4809-8193-50262d1ae694 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:38 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:38 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 1073741824 Aug 11 06:31:38 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-61f2ffe3-4321-4270-bbdf-5ef15e9766e3-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-61f2ffe3-4321-4270-bbdf-5ef15e9766e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-quobyte-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:39 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 1073741824" returned: 0 in 0.458s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0291e81e-e54b-4c83-979b-111a494844b9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:39 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 Aug 11 06:31:39 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:39 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 Aug 11 06:31:39 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:39 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694" returned: 0 in 0.254s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb76a16c-2364-44a3-90d9-e0fd61b02e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4dfd03-b9ba-4809-8193-50262d1ae694', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0098fd-1afa-4d69-9ed1-05e4fc214c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Volume volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 (bb4dfd03-b9ba-4809-8193-50262d1ae694): created successfully Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0098fd-1afa-4d69-9ed1-05e4fc214c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Flow 'volume_create_manager' (c86ef842-4f70-4e96-b2b6-0385dccc810a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-48d241d6-6b64-49cc-abde-50afb39f0a66 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Created volume successfully. Aug 11 06:31:39 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:39 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3 Aug 11 06:31:39 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:39 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" returned: 0 in 0.245s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-61f2ffe3-4321-4270-bbdf-5ef15e9766e3" released by "delete_volume" :: held 0.699s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:39 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Created reservations ['7687a5f3-64e5-42d2-841e-6a730d07dcd5', '352f73ff-c9d7-440a-9b74-979993ba2275', '7703ef71-7dd0-4346-b250-7c7e35380177', '5d0a5bcb-c093-4c2b-bbe0-9e60ea0075e2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:40 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:40 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:40 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.246s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Deleted volume successfully. Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6d8d5717-ae0e-4975-b357-561bff207ed9 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-61f2ffe3-4321-4270-bbdf-5ef15e9766e3-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-ab246c1a-a537-4318-ba3d-56c45d85c577-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-ab246c1a-a537-4318-ba3d-56c45d85c577-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "cinder-quobyte-ab246c1a-a537-4318-ba3d-56c45d85c577" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-ab246c1a-a537-4318-ba3d-56c45d85c577" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea988f88-5869-4b40-86dd-28d236f267d5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:40 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 Aug 11 06:31:40 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Acquiring lock "cinder-bb4dfd03-b9ba-4809-8193-50262d1ae694-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "cinder-bb4dfd03-b9ba-4809-8193-50262d1ae694-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Acquiring lock "cinder-quobyte-bb4dfd03-b9ba-4809-8193-50262d1ae694" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "cinder-quobyte-bb4dfd03-b9ba-4809-8193-50262d1ae694" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5273b190-d653-44b7-b944-25fc8fe7d5d0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:40 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577" returned: 0 in 0.395s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:40 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577 Aug 11 06:31:40 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:40 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 Aug 11 06:31:40 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:41 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab246c1a-a537-4318-ba3d-56c45d85c577" returned: 0 in 0.248s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-quobyte-ab246c1a-a537-4318-ba3d-56c45d85c577" released by "delete_volume" :: held 0.688s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Created reservations ['5b6bf6b2-839b-460c-a52b-722d4a749c53', 'b5caf96e-8379-43eb-aece-063162ca68bd', '53bfde6c-ad55-49e2-ae0b-9e9719351662', '6de2cbcc-db0e-468e-b98a-9496273bec1d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:41 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:41 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694 Aug 11 06:31:41 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:41 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:41 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:41 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bb4dfd03-b9ba-4809-8193-50262d1ae694" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "cinder-quobyte-bb4dfd03-b9ba-4809-8193-50262d1ae694" released by "delete_volume" :: held 0.726s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:41 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Deleted volume successfully. Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Created reservations ['348eabcc-ebdd-43f5-a130-7cf37616c6a4', 'd417d7c7-22b6-4fe6-b737-8913d5913c29', '8b8d0640-28e6-405c-9421-98f2e8c61698', '049ef2ee-fca0-4ff1-8bcb-566b73e27751'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a08f5516-f524-498d-8bb7-145f270a9cc4 tempest-VolumesListAdminTestJSON-1420760892 None] Lock "cinder-ab246c1a-a537-4318-ba3d-56c45d85c577-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:41 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:41 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:42 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:42 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Deleted volume successfully. Aug 11 06:31:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e51f6c9-5318-47f0-b973-eb8f93206192 tempest-VolumeQuotasNegativeTestJSON-680263721 None] Lock "cinder-bb4dfd03-b9ba-4809-8193-50262d1ae694-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b3d1bd23-9d4b-4686-ac14-39ff500a9067 req-81fbfe57-eabe-475e-945d-0c6a8ea44e51 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b3d1bd23-9d4b-4686-ac14-39ff500a9067 req-81fbfe57-eabe-475e-945d-0c6a8ea44e51 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b3d1bd23-9d4b-4686-ac14-39ff500a9067 req-81fbfe57-eabe-475e-945d-0c6a8ea44e51 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b3d1bd23-9d4b-4686-ac14-39ff500a9067 req-81fbfe57-eabe-475e-945d-0c6a8ea44e51 tempest-ServerActionsTestOtherA-1490261714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-0121db57-42b5-4a51-84da-8ce9731f9af7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de727689-43b4-4b9c-a938-4f965c993337', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:31:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-b3d1bd23-9d4b-4686-ac14-39ff500a9067 req-81fbfe57-eabe-475e-945d-0c6a8ea44e51 tempest-ServerActionsTestOtherA-1490261714 None] attachment_update completed successfully. Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Flow 'volume_create_manager' (cef469bc-e3d3-45a7-95e0-8479f61d71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae24215-5a5a-48d8-adee-60b96af3ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae24215-5a5a-48d8-adee-60b96af3ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-869248045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3cf56f-1a89-44f3-81b2-01569c00a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d227b63c44447e9fc42dd7944d44c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:49Z,use_quota=True,user_id='aee7f9fd609a4b7bb36592dd61d0ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa934e59-7e24-4fbf-a9ff-ab66aca9cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa934e59-7e24-4fbf-a9ff-ab66aca9cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e76fa1-d257-482f-8b83-b875fed33c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e76fa1-d257-482f-8b83-b875fed33c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3cf56f-1a89-44f3-81b2-01569c00a747', 'volume_name': 'volume-7a3cf56f-1a89-44f3-81b2-01569c00a747', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98889e2b-16da-4c7d-8ae9-51517b619590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98889e2b-16da-4c7d-8ae9-51517b619590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ca9c71-9e59-4f09-8ce9-d1648d249d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Volume 7a3cf56f-1a89-44f3-81b2-01569c00a747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3cf56f-1a89-44f3-81b2-01569c00a747', 'volume_size': 1} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-869248045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3cf56f-1a89-44f3-81b2-01569c00a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d227b63c44447e9fc42dd7944d44c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:49Z,use_quota=True,user_id='aee7f9fd609a4b7bb36592dd61d0ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Creating volume 7a3cf56f-1a89-44f3-81b2-01569c00a747 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:49 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:49 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 1073741824 Aug 11 06:31:49 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:49 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 1073741824" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:49 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 Aug 11 06:31:49 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Flow 'volume_create_manager' (9207ef3a-d5e6-40ad-b356-892e75f41024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21bb56-4632-446e-8857-a14753a52d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de21bb56-4632-446e-8857-a14753a52d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-334987430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2397e9-f515-4a3d-908c-1a8f72924c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb85b29f7c243c2934c4632dcaae9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:50Z,use_quota=True,user_id='2e1fdd6bb5ae41e190dba4c6ffb1c58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b1954-3236-4481-9f9e-2b98665a8ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b1954-3236-4481-9f9e-2b98665a8ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19652a-1013-4889-8c5a-1a36d7b46fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b19652a-1013-4889-8c5a-1a36d7b46fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2397e9-f515-4a3d-908c-1a8f72924c37', 'volume_name': 'volume-3e2397e9-f515-4a3d-908c-1a8f72924c37', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec544b-1359-4c8a-b11b-ad6640015cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec544b-1359-4c8a-b11b-ad6640015cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f70822-e934-4370-93bd-86ed95bc53cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Volume 3e2397e9-f515-4a3d-908c-1a8f72924c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2397e9-f515-4a3d-908c-1a8f72924c37', 'volume_size': 1} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-ff0c1eee-82bc-49dd-88a1-8cd3082dc5f9 tempest-ServerActionsTestOtherA-1490261714 None] Terminate volume connection completed successfully. Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-ff0c1eee-82bc-49dd-88a1-8cd3082dc5f9 tempest-ServerActionsTestOtherA-1490261714 None] Deleting attachment de727689-43b4-4b9c-a938-4f965c993337. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:31:50 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-334987430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2397e9-f515-4a3d-908c-1a8f72924c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb85b29f7c243c2934c4632dcaae9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:50Z,use_quota=True,user_id='2e1fdd6bb5ae41e190dba4c6ffb1c58d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Creating volume 3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:50 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:50 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 1073741824 Aug 11 06:31:50 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ca9c71-9e59-4f09-8ce9-d1648d249d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3cf56f-1a89-44f3-81b2-01569c00a747', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2670517-b0ee-45d2-868c-b2732fc5d73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Volume volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 (7a3cf56f-1a89-44f3-81b2-01569c00a747): created successfully Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2670517-b0ee-45d2-868c-b2732fc5d73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Flow 'volume_create_manager' (cef469bc-e3d3-45a7-95e0-8479f61d71c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-735daff8-2867-4feb-9fd0-f3245eaee6dc tempest-VolumesTransfersTest-1073196866 None] Created volume successfully. Aug 11 06:31:51 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 1073741824" returned: 0 in 0.832s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:51 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 Aug 11 06:31:51 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-562dbbd4-eca0-4668-b000-a0369b09fd02 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:51 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37" returned: 0 in 0.331s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-562dbbd4-eca0-4668-b000-a0369b09fd02 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.258s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f70822-e934-4370-93bd-86ed95bc53cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2397e9-f515-4a3d-908c-1a8f72924c37', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbaf1e9-e129-4e56-afc6-52a43d3486e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-562dbbd4-eca0-4668-b000-a0369b09fd02 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:51 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Volume volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 (3e2397e9-f515-4a3d-908c-1a8f72924c37): created successfully Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbaf1e9-e129-4e56-afc6-52a43d3486e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Flow 'volume_create_manager' (9207ef3a-d5e6-40ad-b356-892e75f41024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-562dbbd4-eca0-4668-b000-a0369b09fd02 tempest-ServerActionsTestOtherA-1490261714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-0121db57-42b5-4a51-84da-8ce9731f9af7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '013f54d1-476e-46da-a894-5d0db39a7d1b', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:31:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7d0b345f-e135-4381-8b15-22ecc304306d tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Created volume successfully. Aug 11 06:31:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-4a3bda96-ae08-415d-a3e1-9f7c7876b8a5 req-562dbbd4-eca0-4668-b000-a0369b09fd02 tempest-ServerActionsTestOtherA-1490261714 None] attachment_update completed successfully. Aug 11 06:31:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-06c3f21d-b9fc-4f02-a190-795e7fc9cd38 tempest-VolumesTransfersTest-571416798 None] Transfer volume completed successfully. Aug 11 06:31:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Creating offline snapshot 9367dd93-48d3-4f45-bdf4-21072cc79cf1 of volume 3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:31:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b9b7f-ad0c-41ac-8470-97cbe6f4ab2d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:52 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 Aug 11 06:31:52 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:53 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "cinder-7a3cf56f-1a89-44f3-81b2-01569c00a747-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37" returned: 0 in 0.730s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-7a3cf56f-1a89-44f3-81b2-01569c00a747-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:53 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 1G Aug 11 06:31:53 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "cinder-quobyte-7a3cf56f-1a89-44f3-81b2-01569c00a747" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-quobyte-7a3cf56f-1a89-44f3-81b2-01569c00a747" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3f9969-540c-46fe-8e2e-dcf184551464]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:53 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 Aug 11 06:31:53 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:54 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 1G" returned: 0 in 0.988s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:54 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 Aug 11 06:31:54 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:54 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747" returned: 0 in 0.803s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:54 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747 Aug 11 06:31:54 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:54 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7a3cf56f-1a89-44f3-81b2-01569c00a747" returned: 0 in 0.441s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-quobyte-7a3cf56f-1a89-44f3-81b2-01569c00a747" released by "delete_volume" :: held 1.320s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:54 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:54 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 is being set with open permissions: ugo+rw Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:54 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 Aug 11 06:31:54 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Created reservations ['37721880-5baa-42c4-93cc-385c01ec29e8', '07447bc2-9b41-4e1c-ad7b-92a4abc7be27', '748d4682-b56c-4a7d-a924-ff650bad5427', '8e777110-c19c-483a-a795-74720590eaee'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:55 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:31:55 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:55 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:55 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info Aug 11 06:31:55 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:55 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.437s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:31:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Deleted volume successfully. Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-65ea5511-e1c7-45fd-974f-0d013693b7f8 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-7a3cf56f-1a89-44f3-81b2-01569c00a747-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-db75cd66-e588-459f-a809-0308613f0be0 req-ecf3e9d3-5cfd-4f7e-a4d4-439b323b42b9 tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:55 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:55 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info is being set with open permissions: ugo+rw Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:55 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info Aug 11 06:31:55 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:55 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.info" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-db75cd66-e588-459f-a809-0308613f0be0 req-ecf3e9d3-5cfd-4f7e-a4d4-439b323b42b9 tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.285s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-db75cd66-e588-459f-a809-0308613f0be0 req-ecf3e9d3-5cfd-4f7e-a4d4-439b323b42b9 tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-526ae6e5-2f52-47a4-8f7e-257f5a91bb03 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Create snapshot completed successfully Aug 11 06:31:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-db75cd66-e588-459f-a809-0308613f0be0 req-ecf3e9d3-5cfd-4f7e-a4d4-439b323b42b9 tempest-TaggedAttachmentsTest-1186048019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-7bb8d486-97c7-4f01-a212-df672d3133f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86e21d32-aed2-41c8-8b00-e5d9f340e40d', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:31:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-db75cd66-e588-459f-a809-0308613f0be0 req-ecf3e9d3-5cfd-4f7e-a4d4-439b323b42b9 tempest-TaggedAttachmentsTest-1186048019 None] attachment_update completed successfully. Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Flow 'volume_create_manager' (a39211ae-f972-4002-aef5-80c8df2df617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88006012-96c8-4ac9-afbf-22fc2ecd066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88006012-96c8-4ac9-afbf-22fc2ecd066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1374230121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8fe184-7d11-47f2-aebb-c3b5806e6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d227b63c44447e9fc42dd7944d44c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:56Z,use_quota=True,user_id='aee7f9fd609a4b7bb36592dd61d0ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3dd08c-6b72-4bca-825c-3a59a920c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3dd08c-6b72-4bca-825c-3a59a920c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475868c-ea46-415d-93e7-c9d1d618de48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475868c-ea46-415d-93e7-c9d1d618de48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8fe184-7d11-47f2-aebb-c3b5806e6897', 'volume_name': 'volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55c0971-0b35-4c98-97c2-70f1a6ea0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55c0971-0b35-4c98-97c2-70f1a6ea0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac9b42-dca5-47df-9222-3b0054e047d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Volume 2b8fe184-7d11-47f2-aebb-c3b5806e6897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897', 'volume_size': 1} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1374230121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8fe184-7d11-47f2-aebb-c3b5806e6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d227b63c44447e9fc42dd7944d44c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:31:56Z,use_quota=True,user_id='aee7f9fd609a4b7bb36592dd61d0ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Creating volume 2b8fe184-7d11-47f2-aebb-c3b5806e6897 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:31:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:31:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:56 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 1073741824 Aug 11 06:31:56 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:57 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 1073741824" returned: 0 in 0.736s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:57 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 Aug 11 06:31:57 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "cinder-9367dd93-48d3-4f45-bdf4-21072cc79cf1-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-9367dd93-48d3-4f45-bdf4-21072cc79cf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "cinder-quobyte-9367dd93-48d3-4f45-bdf4-21072cc79cf1" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-9367dd93-48d3-4f45-bdf4-21072cc79cf1" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Deleting offline snapshot 9367dd93-48d3-4f45-bdf4-21072cc79cf1 of volume 3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] snapshot_file for this snap is: volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7732095-420b-4751-963e-ac6f3bd5f56b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:57 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897" returned: 0 in 0.468s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac9b42-dca5-47df-9222-3b0054e047d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c4123d-16f9-45cc-bc77-47b1bd52b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:31:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Volume volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 (2b8fe184-7d11-47f2-aebb-c3b5806e6897): created successfully Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c4123d-16f9-45cc-bc77-47b1bd52b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:31:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Flow 'volume_create_manager' (a39211ae-f972-4002-aef5-80c8df2df617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:31:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-95a04c99-af4c-4d6e-a7c6-7b04135a9e4f tempest-VolumesTransfersTest-1073196866 None] Created volume successfully. Aug 11 06:31:57 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 Aug 11 06:31:57 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:58 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1" returned: 0 in 0.579s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e2397e9-f515-4a3d-908c-1a8f72924c37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07284033-f812-4d1c-ac16-f6bf817e139b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:58 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 Aug 11 06:31:58 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:58 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37" returned: 0 in 0.550s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:58 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 Aug 11 06:31:58 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "cinder-2b8fe184-7d11-47f2-aebb-c3b5806e6897-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-2b8fe184-7d11-47f2-aebb-c3b5806e6897-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "cinder-quobyte-2b8fe184-7d11-47f2-aebb-c3b5806e6897" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-quobyte-2b8fe184-7d11-47f2-aebb-c3b5806e6897" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890cb39-842a-467a-a1a6-388a97fe062b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:59 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 Aug 11 06:31:59 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:59 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1" returned: 0 in 0.464s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:59 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1 Aug 11 06:31:59 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-a7bb48a1-81e4-4ab0-8879-5f69c87f9eb5 req-31451269-51f9-4313-8fea-381e0f42275a tempest-TaggedAttachmentsTest-1186048019 None] Terminate volume connection completed successfully. Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-a7bb48a1-81e4-4ab0-8879-5f69c87f9eb5 req-31451269-51f9-4313-8fea-381e0f42275a tempest-TaggedAttachmentsTest-1186048019 None] Deleting attachment 86e21d32-aed2-41c8-8b00-e5d9f340e40d. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:31:59 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:31:59 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897 Aug 11 06:31:59 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:31:59 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37.9367dd93-48d3-4f45-bdf4-21072cc79cf1" returned: 0 in 0.344s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-9367dd93-48d3-4f45-bdf4-21072cc79cf1" released by "_delete_snapshot" :: held 2.124s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" released by "delete_snapshot" :: held 2.169s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:31:59 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:31:59 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Aug 11 06:31:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2b8fe184-7d11-47f2-aebb-c3b5806e6897" returned: 0 in 0.404s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-quobyte-2b8fe184-7d11-47f2-aebb-c3b5806e6897" released by "delete_volume" :: held 0.945s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Created reservations ['f3cf70af-1052-4717-9bba-f32d8c8009a4', '8513f374-197a-4e55-9106-8d38665d9687', 'd43a8a55-b385-4610-87d5-a60ae0eac160', '97b0f6c5-1d33-48a9-87ce-bae1e385abe5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Created reservations ['b768f786-59fc-4c53-b9c2-f3e92b481ed3', '72ae9095-7835-410e-a670-2191d659fe81', 'aaa82f36-eb35-4bf1-b3df-dae97e4d9a2a', 'bfa4e2b8-de2a-4808-8a12-b3106018cbe0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Delete snapshot completed successfully. Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1cd25167-9ed1-408f-9c70-7f70ce0d0f78 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-9367dd93-48d3-4f45-bdf4-21072cc79cf1-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:00 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:00 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:00 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Deleted volume successfully. Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69df6ed-0205-4d2c-9de3-83faea211aa6 tempest-VolumesTransfersTest-1417939178 None] Lock "cinder-2b8fe184-7d11-47f2-aebb-c3b5806e6897-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "cinder-3e2397e9-f515-4a3d-908c-1a8f72924c37-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-3e2397e9-f515-4a3d-908c-1a8f72924c37-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[71898ceb-ed06-479b-8074-1ccc897327b2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:01 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 Aug 11 06:32:01 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:01 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37" returned: 0 in 0.544s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:01 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37 Aug 11 06:32:01 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:02 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e2397e9-f515-4a3d-908c-1a8f72924c37" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-quobyte-3e2397e9-f515-4a3d-908c-1a8f72924c37" released by "delete_volume" :: held 1.211s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Created reservations ['38c1019b-e7af-4f65-817b-24ba50ed8dce', '3a7cf14a-a5cd-4330-a4be-ec9b0f1f788d', 'de814319-213f-4566-917b-ad7663f2c1f4', '79efa9e3-8148-480b-867e-bc1c7dc31fc0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:02 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:02 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:03 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.376s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:03 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Deleted volume successfully. Aug 11 06:32:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1b14f65f-fa31-4c67-bc68-f613299895e6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1196270750 None] Lock "cinder-3e2397e9-f515-4a3d-908c-1a8f72924c37-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=120,cinder:UPDATE=165,cinder:INSERT=37,cinder:DELETE=6 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "cinder-7bb8d486-97c7-4f01-a212-df672d3133f5-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "cinder-7bb8d486-97c7-4f01-a212-df672d3133f5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=136,cinder:INSERT=30,cinder:UPDATE=129,cinder:DELETE=14 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Flow 'volume_create_manager' (39e28700-3fe4-400b-bf01-dfa4f330d066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c103e5-1e87-4a7d-a980-3fb08d12bf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "cinder-quobyte-7bb8d486-97c7-4f01-a212-df672d3133f5" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c103e5-1e87-4a7d-a980-3fb08d12bf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-63959450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6683a3e0-d5ab-4a7e-b641-194c9600d247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af734296c38447518a0193361420624f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:13Z,use_quota=True,user_id='f5803ac3b7054fddbaaf654001d8b44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787473d7-379d-49fa-a2e6-b79f7841facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787473d7-379d-49fa-a2e6-b79f7841facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e54111a-1a51-4f3f-b2fd-f215a2546499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e54111a-1a51-4f3f-b2fd-f215a2546499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6683a3e0-d5ab-4a7e-b641-194c9600d247', 'volume_name': 'volume-6683a3e0-d5ab-4a7e-b641-194c9600d247', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00981606-49b7-46dd-837b-dd0abd03dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00981606-49b7-46dd-837b-dd0abd03dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5ca5c8-d9c1-43d5-900b-ed48c5cfed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Volume 6683a3e0-d5ab-4a7e-b641-194c9600d247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6683a3e0-d5ab-4a7e-b641-194c9600d247', 'volume_size': 1} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-63959450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6683a3e0-d5ab-4a7e-b641-194c9600d247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af734296c38447518a0193361420624f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:13Z,use_quota=True,user_id='f5803ac3b7054fddbaaf654001d8b44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Creating volume 6683a3e0-d5ab-4a7e-b641-194c9600d247 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:12 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "cinder-quobyte-7bb8d486-97c7-4f01-a212-df672d3133f5" acquired by "delete_volume" :: waited 0.078s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:12 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 1073741824 Aug 11 06:32:12 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[41841138-f25c-424e-b22f-855498bc5e87]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:13 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 Aug 11 06:32:13 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:13 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:13 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5 Aug 11 06:32:13 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:13 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 1073741824" returned: 0 in 0.529s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:13 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 Aug 11 06:32:13 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:13 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7bb8d486-97c7-4f01-a212-df672d3133f5" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "cinder-quobyte-7bb8d486-97c7-4f01-a212-df672d3133f5" released by "delete_volume" :: held 0.781s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:13 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Created reservations ['003cd744-be45-41bb-8996-afba51bf204f', 'f6c332e8-2c21-488f-9a88-6f5b51f34442', 'b2996a5d-4e08-4b9c-a64f-8d475fee6268', '75fec8d0-b1ac-4230-990d-522b39d5dedf'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5ca5c8-d9c1-43d5-900b-ed48c5cfed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6683a3e0-d5ab-4a7e-b641-194c9600d247', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520ffd8d-d84e-4824-9b41-0f1258936c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Volume volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 (6683a3e0-d5ab-4a7e-b641-194c9600d247): created successfully Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520ffd8d-d84e-4824-9b41-0f1258936c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Flow 'volume_create_manager' (39e28700-3fe4-400b-bf01-dfa4f330d066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9abf8059-0ad6-4ab4-95be-23e002b88e47 tempest-VolumesTransfersV355Test-1992793043 None] Created volume successfully. Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:13 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:13 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:14 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:14 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Deleted volume successfully. Aug 11 06:32:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-47c14e02-2d88-47b2-901b-ce592f385369 tempest-TaggedAttachmentsTest-1186048019 None] Lock "cinder-7bb8d486-97c7-4f01-a212-df672d3133f5-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:15 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:15 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:15 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 8 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:32:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:32:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c8d3fab8-097e-457c-93b2-5060aa2049a4 tempest-VolumesTransfersV355Test-540294343 None] Transfer volume completed successfully. Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "cinder-6683a3e0-d5ab-4a7e-b641-194c9600d247-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-6683a3e0-d5ab-4a7e-b641-194c9600d247-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "cinder-quobyte-6683a3e0-d5ab-4a7e-b641-194c9600d247" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-quobyte-6683a3e0-d5ab-4a7e-b641-194c9600d247" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789e11a-d014-4c41-90af-db074afb162a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:16 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 Aug 11 06:32:16 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:17 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247" returned: 0 in 0.402s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:17 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247 Aug 11 06:32:17 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:17 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6683a3e0-d5ab-4a7e-b641-194c9600d247" returned: 0 in 0.248s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-quobyte-6683a3e0-d5ab-4a7e-b641-194c9600d247" released by "delete_volume" :: held 0.705s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Created reservations ['2f32e39a-a050-4063-a70b-81139993ebeb', 'c0b60a70-6210-48f4-a290-3751f8992463', '7a6f07d7-fbe3-46d9-b966-d504ef072ca6', '68d469f4-90ff-4135-b248-b0b8a8b160ae'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:17 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:17 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:17 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Deleted volume successfully. Aug 11 06:32:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37707af7-c04a-4e1e-846f-1593f6d77092 tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-6683a3e0-d5ab-4a7e-b641-194c9600d247-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Flow 'volume_create_manager' (c0fb4e45-3061-4731-9bc7-d315a210d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee3306f-3bfc-466c-8c79-49787fb52e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee3306f-3bfc-466c-8c79-49787fb52e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2048197815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff19117-1929-47e7-9063-c018be9e12ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af734296c38447518a0193361420624f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:19Z,use_quota=True,user_id='f5803ac3b7054fddbaaf654001d8b44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573a10ae-5976-4317-945d-c2a92e6450ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573a10ae-5976-4317-945d-c2a92e6450ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26253e0f-70ab-4013-b74a-4b0e78aebc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26253e0f-70ab-4013-b74a-4b0e78aebc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff19117-1929-47e7-9063-c018be9e12ad', 'volume_name': 'volume-cff19117-1929-47e7-9063-c018be9e12ad', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663b1b6e-6bd7-4396-92c9-7375746669c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663b1b6e-6bd7-4396-92c9-7375746669c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef356314-0bb8-40b8-988f-819dece1fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:18 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Volume cff19117-1929-47e7-9063-c018be9e12ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff19117-1929-47e7-9063-c018be9e12ad', 'volume_size': 1} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2048197815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff19117-1929-47e7-9063-c018be9e12ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af734296c38447518a0193361420624f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:19Z,use_quota=True,user_id='f5803ac3b7054fddbaaf654001d8b44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Creating volume cff19117-1929-47e7-9063-c018be9e12ad {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:18 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:18 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad 1073741824 Aug 11 06:32:18 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:19 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad 1073741824" returned: 0 in 0.604s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:19 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad Aug 11 06:32:19 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:19 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad" returned: 0 in 0.368s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef356314-0bb8-40b8-988f-819dece1fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff19117-1929-47e7-9063-c018be9e12ad', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ff654-332e-43b6-aba3-9dbeb1e41650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:19 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Volume volume-cff19117-1929-47e7-9063-c018be9e12ad (cff19117-1929-47e7-9063-c018be9e12ad): created successfully Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ff654-332e-43b6-aba3-9dbeb1e41650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Flow 'volume_create_manager' (c0fb4e45-3061-4731-9bc7-d315a210d97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d42c76e5-6c96-4530-add8-b04a0c703af8 tempest-VolumesTransfersV355Test-1992793043 None] Created volume successfully. Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "cinder-cff19117-1929-47e7-9063-c018be9e12ad-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-cff19117-1929-47e7-9063-c018be9e12ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "cinder-quobyte-cff19117-1929-47e7-9063-c018be9e12ad" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-quobyte-cff19117-1929-47e7-9063-c018be9e12ad" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d594d405-0e05-4628-bc9c-f41446cf8c6e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:21 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad Aug 11 06:32:21 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:21 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad" returned: 0 in 0.564s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:21 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad Aug 11 06:32:21 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Flow 'volume_create_manager' (3c0749c5-542d-4617-9b85-98f8ff5bbd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c9a75-471a-4bfe-ab0a-7b175a3fbbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1c9a75-471a-4bfe-ab0a-7b175a3fbbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2113231532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e00e48-1745-47d2-a875-49308efb93ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3c8a432b4268971f0392eeac9e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:22Z,use_quota=True,user_id='6b4a2eb6dc334dddbca84743a10b959b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b37a96-b9f5-4ae0-b03c-a8cc05076e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b37a96-b9f5-4ae0-b03c-a8cc05076e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862ca22a-6f17-4d9b-8d2f-336d8a5f1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862ca22a-6f17-4d9b-8d2f-336d8a5f1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e00e48-1745-47d2-a875-49308efb93ef', 'volume_name': 'volume-92e00e48-1745-47d2-a875-49308efb93ef', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374d8d69-0698-4536-88fd-b0491f897b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374d8d69-0698-4536-88fd-b0491f897b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4ebea5-37df-4ca7-9494-0486fe59a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:22 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Volume 92e00e48-1745-47d2-a875-49308efb93ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e00e48-1745-47d2-a875-49308efb93ef', 'volume_size': 1} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2113231532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e00e48-1745-47d2-a875-49308efb93ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ee3c8a432b4268971f0392eeac9e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:22Z,use_quota=True,user_id='6b4a2eb6dc334dddbca84743a10b959b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Creating volume 92e00e48-1745-47d2-a875-49308efb93ef {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:22 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:22 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef 1073741824 Aug 11 06:32:22 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:22 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cff19117-1929-47e7-9063-c018be9e12ad" returned: 0 in 0.368s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-8deec6b6-e6ff-44ac-8f7b-486e39437591 req-5957ee6f-7c2a-4376-bee1-b337399c0666 tempest-ServerActionsTestOtherA-1490261714 None] Terminate volume connection completed successfully. Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-8deec6b6-e6ff-44ac-8f7b-486e39437591 req-5957ee6f-7c2a-4376-bee1-b337399c0666 tempest-ServerActionsTestOtherA-1490261714 None] Deleting attachment 013f54d1-476e-46da-a894-5d0db39a7d1b. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-quobyte-cff19117-1929-47e7-9063-c018be9e12ad" released by "delete_volume" :: held 1.002s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Created reservations ['32464843-9e10-4d1f-9f66-30f2508a723a', '6770d32a-f85b-49a4-b6e3-29f1b31c70e9', 'e83cf368-12da-46f9-9e4d-70077bfe39a2', '744bd74d-6c33-4630-85ee-0113704573b0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:22 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:22 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:22 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef 1073741824" returned: 0 in 0.605s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:22 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Deleted volume successfully. Aug 11 06:32:22 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef Aug 11 06:32:22 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5828e8e6-83a0-470f-a941-16f8397ef42c tempest-VolumesTransfersV355Test-631432224 None] Lock "cinder-cff19117-1929-47e7-9063-c018be9e12ad-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:23 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4ebea5-37df-4ca7-9494-0486fe59a6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e00e48-1745-47d2-a875-49308efb93ef', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5debdece-2296-4750-aef2-dfb6ce01fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Volume volume-92e00e48-1745-47d2-a875-49308efb93ef (92e00e48-1745-47d2-a875-49308efb93ef): created successfully Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5debdece-2296-4750-aef2-dfb6ce01fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Flow 'volume_create_manager' (3c0749c5-542d-4617-9b85-98f8ff5bbd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f94db8fa-14fe-46e2-8bf5-0cde28c21ced tempest-AbsoluteLimitsTests-1862868116 None] Created volume successfully. Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Acquiring lock "cinder-92e00e48-1745-47d2-a875-49308efb93ef-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "cinder-92e00e48-1745-47d2-a875-49308efb93ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Acquiring lock "cinder-quobyte-92e00e48-1745-47d2-a875-49308efb93ef" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "cinder-quobyte-92e00e48-1745-47d2-a875-49308efb93ef" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[886602f1-8d24-497c-a633-9cd5e8c39b1d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:24 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef Aug 11 06:32:24 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:25 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef" returned: 0 in 0.458s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:25 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef Aug 11 06:32:25 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:25 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-92e00e48-1745-47d2-a875-49308efb93ef" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "cinder-quobyte-92e00e48-1745-47d2-a875-49308efb93ef" released by "delete_volume" :: held 0.875s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Created reservations ['524c615b-2232-4669-aa3b-a141763fff61', '4135c6e6-e328-4a83-90ec-c737ba8e29cd', 'bcbfb941-df44-4b1b-bb2c-1a5f35c14ffb', 'd68d945b-5eeb-48b5-ac67-c3804080645f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:25 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:25 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:26 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.364s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:26 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Deleted volume successfully. Aug 11 06:32:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f96f177b-6863-4dbb-a7c9-4664eb8e4a22 tempest-AbsoluteLimitsTests-1862868116 None] Lock "cinder-92e00e48-1745-47d2-a875-49308efb93ef-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Flow 'volume_create_manager' (4145de13-02d3-40df-9f70-e4f1041167be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bcb1d1-b90c-4b41-aa5f-06a25d8b81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bcb1d1-b90c-4b41-aa5f-06a25d8b81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1629065266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8350146a-7f66-45c8-a6a9-409dff4f9817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f5028d3da4e65a762dbcc69575d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:31Z,use_quota=True,user_id='f251a3d9fc9e4e52867d15d4db44b05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11fa17e-c6e7-4056-af3d-1aa78a0f5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11fa17e-c6e7-4056-af3d-1aa78a0f5248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3dad90-98d6-47c8-8b9e-7211f4e55d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:31 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Flow 'volume_create_manager' (11962f25-a568-4931-b708-3fda1cdd859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6f3b8c-7218-44c4-a079-16f9a9c4568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6f3b8c-7218-44c4-a079-16f9a9c4568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-921400750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab842ca1-03f6-4565-8e48-5dfa0cbb3846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fe9910534a4af0ae902eaf446f7307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:32Z,use_quota=True,user_id='353e1aa1b92246f6b00d588ac91ee404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e667b231-fc57-4d95-a6b7-442779b0fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e667b231-fc57-4d95-a6b7-442779b0fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526b030-0d27-4718-a2f4-829de37d4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526b030-0d27-4718-a2f4-829de37d4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab842ca1-03f6-4565-8e48-5dfa0cbb3846', 'volume_name': 'volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0012918f-bc9c-46f0-8360-7835c0e0c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0012918f-bc9c-46f0-8360-7835c0e0c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56013237-97aa-4e13-8d88-7604ccac2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Volume ab842ca1-03f6-4565-8e48-5dfa0cbb3846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846', 'volume_size': 1} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-921400750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab842ca1-03f6-4565-8e48-5dfa0cbb3846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4fe9910534a4af0ae902eaf446f7307',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:32Z,use_quota=True,user_id='353e1aa1b92246f6b00d588ac91ee404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Creating volume ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:32 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:32 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 1073741824 Aug 11 06:32:32 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3dad90-98d6-47c8-8b9e-7211f4e55d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8350146a-7f66-45c8-a6a9-409dff4f9817', 'volume_name': 'volume-8350146a-7f66-45c8-a6a9-409dff4f9817', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e350d117-8ebb-4e01-a362-596bffa09c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e350d117-8ebb-4e01-a362-596bffa09c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b05e7d-8016-4ceb-a681-7c4a5a79c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Volume 8350146a-7f66-45c8-a6a9-409dff4f9817: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8350146a-7f66-45c8-a6a9-409dff4f9817', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 06:32:32 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Trying to clone 8350146a-7f66-45c8-a6a9-409dff4f9817 from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:32:33 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 1073741824" returned: 0 in 0.645s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:33 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 Aug 11 06:32:33 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:32:33 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Image download 20.69 MB at 20.69 MB/s Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa7b39-9aaa-42d7-93ea-16d42a2545cd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:33 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD Aug 11 06:32:33 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:33 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" returned: 0 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56013237-97aa-4e13-8d88-7604ccac2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a142da-2eb4-4dec-9e18-e1260f7fb5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Volume volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 (ab842ca1-03f6-4565-8e48-5dfa0cbb3846): created successfully Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a142da-2eb4-4dec-9e18-e1260f7fb5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Flow 'volume_create_manager' (11962f25-a568-4931-b708-3fda1cdd859f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-29b66bc4-52ad-4314-a3bd-bcae631c2a4a req-dfebff3c-fce9-4089-8193-efdd5b8f2a00 tempest-VolumesSnapshotsTestJSON-142515288 None] Created volume successfully. Aug 11 06:32:33 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:33 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 is fetched for user f251a3d9fc9e4e52867d15d4db44b05f. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a34bb8-46d6-47dc-9d42-b476a851f136]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:34 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD Aug 11 06:32:34 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:34 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1629065266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8350146a-7f66-45c8-a6a9-409dff4f9817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4f5028d3da4e65a762dbcc69575d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:31Z,use_quota=True,user_id='f251a3d9fc9e4e52867d15d4db44b05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Creating volume 8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:34 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:34 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1073741824 Aug 11 06:32:34 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:34 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1073741824" returned: 0 in 0.544s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:35 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 Aug 11 06:32:35 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:35 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.204s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Creating offline snapshot b53c09d5-0538-48d0-942b-d531bae6aeca of volume ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Attempting download of b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 8350146a-7f66-45c8-a6a9-409dff4f9817. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[df26f6a1-9dea-455a-a005-38ea2ea8e31d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Flow 'volume_create_manager' (524b522d-54cb-4b2b-bcb5-3f68001c5260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c065517c-0ce7-47ae-9c38-30d44b4d47c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8547c-8cbd-48cd-afbb-d797d7b944e0]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c065517c-0ce7-47ae-9c38-30d44b4d47c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-665003034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025973b6-b8a3-47c9-90af-f2752dc506e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686d1f796b7d4bb6b99cee3b743a1835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:35Z,use_quota=True,user_id='231d37320bd14aa4960f94259aa502a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33344093-03bf-46fb-87c7-1c1b508961e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33344093-03bf-46fb-87c7-1c1b508961e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaf0ef0-bab1-458f-8dd4-241c9ddde97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbaf0ef0-bab1-458f-8dd4-241c9ddde97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025973b6-b8a3-47c9-90af-f2752dc506e9', 'volume_name': 'volume-025973b6-b8a3-47c9-90af-f2752dc506e9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702dbf45-bcf6-4221-b44b-fd665ab5a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702dbf45-bcf6-4221-b44b-fd665ab5a698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769adc1d-c188-4b1f-86b6-97140fcdc4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:35 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Volume 025973b6-b8a3-47c9-90af-f2752dc506e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025973b6-b8a3-47c9-90af-f2752dc506e9', 'volume_size': 1} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:35 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 Aug 11 06:32:35 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:35 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep Aug 11 06:32:35 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:35 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:35 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca 1G Aug 11 06:32:35 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:35 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep" returned: 0 in 0.449s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep Aug 11 06:32:36 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (b6d305bd-4b12-458e-9139-d4cd7a6b10ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:36 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fdc314-529b-4ad3-a442-21a77556f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep" returned: 1 in 0.383s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_fauphpep' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0dadbf-099e-4a53-bd4c-5f507bf66ec7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fdc314-529b-4ad3-a442-21a77556f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670113630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cb5415-0dd5-45c1-b52e-30dda24cfebb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:36Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d9c586-a9ee-47a5-9262-c586e81356ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d9c586-a9ee-47a5-9262-c586e81356ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200999a6-deb5-4a7f-aead-78ad91c446c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:36 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200999a6-deb5-4a7f-aead-78ad91c446c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1cb5415-0dd5-45c1-b52e-30dda24cfebb', 'volume_name': 'volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cd57a8-539e-47c9-b85e-3158aa89ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cd57a8-539e-47c9-b85e-3158aa89ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdb0e60-7f48-4bc6-b7b7-7d6ed019e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:36 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Volume b1cb5415-0dd5-45c1-b52e-30dda24cfebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb', 'volume_size': 1} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca 1G" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca Aug 11 06:32:36 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:36 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD Aug 11 06:32:36 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:36 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:36 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:36 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca is being set with open permissions: ugo+rw Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] b9bfbb5e-34f5-42dc-847f-82185f2020b1 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca Aug 11 06:32:36 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:36 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 Aug 11 06:32:36 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:36 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca" returned: 0 in 0.252s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:36 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info Aug 11 06:32:36 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:37 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info is being set with open permissions: ugo+rw Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:37 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info Aug 11 06:32:37 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:37 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.info" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.995s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-665003034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025973b6-b8a3-47c9-90af-f2752dc506e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686d1f796b7d4bb6b99cee3b743a1835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:35Z,use_quota=True,user_id='231d37320bd14aa4960f94259aa502a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Creating volume 025973b6-b8a3-47c9-90af-f2752dc506e9 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:37 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:37 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 1073741824 Aug 11 06:32:37 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-0280d141-1560-4f33-a95f-4f926417f4e9 req-542c1520-259a-4273-abc9-2e7cb1fc794d tempest-VolumesSnapshotsTestJSON-142515288 None] Create snapshot completed successfully Aug 11 06:32:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "cinder-b53c09d5-0538-48d0-942b-d531bae6aeca-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-b53c09d5-0538-48d0-942b-d531bae6aeca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "cinder-quobyte-b53c09d5-0538-48d0-942b-d531bae6aeca" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-b53c09d5-0538-48d0-942b-d531bae6aeca" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Deleting offline snapshot b53c09d5-0538-48d0-942b-d531bae6aeca of volume ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] snapshot_file for this snap is: volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:32:38 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 1073741824" returned: 0 in 0.590s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a9dd3d-fb6b-49cf-8ecb-7535135285b9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:38 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 Aug 11 06:32:38 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:38 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca Aug 11 06:32:38 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:38 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9" returned: 0 in 0.339s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670113630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1cb5415-0dd5-45c1-b52e-30dda24cfebb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:36Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Creating volume b1cb5415-0dd5-45c1-b52e-30dda24cfebb {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:38 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:38 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb 1073741824 Aug 11 06:32:38 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769adc1d-c188-4b1f-86b6-97140fcdc4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025973b6-b8a3-47c9-90af-f2752dc506e9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e0b3f3-6ccb-446d-adc3-99f0db5b8192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:38 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Volume volume-025973b6-b8a3-47c9-90af-f2752dc506e9 (025973b6-b8a3-47c9-90af-f2752dc506e9): created successfully Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e0b3f3-6ccb-446d-adc3-99f0db5b8192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Flow 'volume_create_manager' (524b522d-54cb-4b2b-bcb5-3f68001c5260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-799e6266-8b87-4da7-baf9-79328a41fe40 tempest-VolumesTransfersV357Test-217497913 None] Created volume successfully. Aug 11 06:32:38 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe493e0f-82a1-4ef0-b3c2-897cdbe7f7df]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:38 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817" returned: 0 in 2.177s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_hda6f0egdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:32:38 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Converted 112.00 MB image at 51.42 MB/s Aug 11 06:32:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:38 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 Aug 11 06:32:38 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1G Aug 11 06:32:38 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:38 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:39 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb 1073741824" returned: 0 in 0.562s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:39 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb Aug 11 06:32:39 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:39 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca Aug 11 06:32:39 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:39 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 1G" returned: 0 in 0.466s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Downloaded image b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 8350146a-7f66-45c8-a6a9-409dff4f9817 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 for user f251a3d9fc9e4e52867d15d4db44b05f is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Marking volume 8350146a-7f66-45c8-a6a9-409dff4f9817 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Copying metadata from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 to 8350146a-7f66-45c8-a6a9-409dff4f9817. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Creating volume glance metadata for volume 8350146a-7f66-45c8-a6a9-409dff4f9817 backed by image b9bfbb5e-34f5-42dc-847f-82185f2020b1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b05e7d-8016-4ceb-a681-7c4a5a79c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8350146a-7f66-45c8-a6a9-409dff4f9817', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008e3036-64b6-47dd-9147-f3f64a5756a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Volume volume-8350146a-7f66-45c8-a6a9-409dff4f9817 (8350146a-7f66-45c8-a6a9-409dff4f9817): created successfully Aug 11 06:32:39 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008e3036-64b6-47dd-9147-f3f64a5756a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Flow 'volume_create_manager' (4145de13-02d3-40df-9f70-e4f1041167be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" returned: 0 in 0.373s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6b37fc7e-a324-406a-b26c-a9e9144ad643 tempest-ServerActionsTestOtherA-1490261714 None] Created volume successfully. Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdb0e60-7f48-4bc6-b7b7-7d6ed019e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c3ba93-4268-488c-8e82-5d90dd8df05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Volume volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb (b1cb5415-0dd5-45c1-b52e-30dda24cfebb): created successfully Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c3ba93-4268-488c-8e82-5d90dd8df05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (b6d305bd-4b12-458e-9139-d4cd7a6b10ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c666eab4-a4a7-4e8f-867f-7568ca469a99 tempest-VolumesListTestJSON-2096307790 None] Created volume successfully. Aug 11 06:32:39 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca" returned: 0 in 0.470s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:39 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca Aug 11 06:32:39 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:39 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846.b53c09d5-0538-48d0-942b-d531bae6aeca" returned: 0 in 0.252s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-b53c09d5-0538-48d0-942b-d531bae6aeca" released by "_delete_snapshot" :: held 1.872s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" released by "delete_snapshot" :: held 1.907s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.quota [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Created reservations ['dc30f0f1-e4e6-404b-9459-9e0de8fef589', '550ae143-8f2d-4602-9648-06168dafd098', 'ed8f9710-38d2-4d7f-8179-c5e6f768ee9a', '7d98b2e1-fe75-438c-bdf3-1a9039a9b47e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Delete snapshot completed successfully. Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-d8831601-68d3-4c5d-a395-b4df1425f4ae req-22e25b03-93e6-4334-b1e2-8bc23e50f4d3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-b53c09d5-0538-48d0-942b-d531bae6aeca-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "cinder-ab842ca1-03f6-4565-8e48-5dfa0cbb3846-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-ab842ca1-03f6-4565-8e48-5dfa0cbb3846-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-63d5f1c2-ecee-4996-b836-da014c5123cf tempest-VolumesTransfersV357Test-1544577734 None] Transfer volume completed successfully. Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e7be24-e3aa-4487-9254-1b16e8487ce0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:40 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 Aug 11 06:32:40 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:41 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" returned: 0 in 0.571s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:41 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846 Aug 11 06:32:41 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (56cba3a9-dfc5-4797-bf1e-ee554e44a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894f8573-40c0-476c-8179-dc217ff77118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894f8573-40c0-476c-8179-dc217ff77118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1046089127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d143353-2ab4-40df-8d3e-94b17afed3d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:41Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a708b10-c941-43c9-8c30-3708fe6b4faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a708b10-c941-43c9-8c30-3708fe6b4faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15aaabab-9e6b-4dd2-a798-63ff37af37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15aaabab-9e6b-4dd2-a798-63ff37af37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d143353-2ab4-40df-8d3e-94b17afed3d4', 'volume_name': 'volume-9d143353-2ab4-40df-8d3e-94b17afed3d4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a635e4b-0de8-43fa-9539-8fd345a5eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a635e4b-0de8-43fa-9539-8fd345a5eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4454ea-6399-4e3f-a069-70da1b0efe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Volume 9d143353-2ab4-40df-8d3e-94b17afed3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d143353-2ab4-40df-8d3e-94b17afed3d4', 'volume_size': 1} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1046089127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d143353-2ab4-40df-8d3e-94b17afed3d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:41Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Creating volume 9d143353-2ab4-40df-8d3e-94b17afed3d4 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:41 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "cinder-025973b6-b8a3-47c9-90af-f2752dc506e9-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-025973b6-b8a3-47c9-90af-f2752dc506e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:41 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 1073741824 Aug 11 06:32:41 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:41 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" returned: 0 in 0.362s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-quobyte-ab842ca1-03f6-4565-8e48-5dfa0cbb3846" released by "delete_volume" :: held 1.057s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "cinder-quobyte-025973b6-b8a3-47c9-90af-f2752dc506e9" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-quobyte-025973b6-b8a3-47c9-90af-f2752dc506e9" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f69b7-8d04-4b43-89d4-216d65c6f8f9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.quota [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Created reservations ['2b9bb86e-17d7-4a90-b072-982fbea13c49', '3ba8a67a-ce9d-4135-ae54-ca3a5718b949', 'c0c24e4b-1cb0-4e63-9df9-c30f8a6ab6ca', '7a7a7ad1-d3f9-4a1b-90f7-47253c184bc2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:41 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 Aug 11 06:32:41 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:41 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:41 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:41 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 1073741824" returned: 0 in 0.616s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:42 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 Aug 11 06:32:42 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:42 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9" returned: 0 in 0.482s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:42 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.manager [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Deleted volume successfully. Aug 11 06:32:42 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9 Aug 11 06:32:42 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-8d290c34-7fe0-4628-961a-7f30c72894cb req-4c580d47-1173-45d4-ae99-6af2fec289e3 tempest-VolumesSnapshotsTestJSON-142515288 None] Lock "cinder-ab842ca1-03f6-4565-8e48-5dfa0cbb3846-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:42 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4454ea-6399-4e3f-a069-70da1b0efe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d143353-2ab4-40df-8d3e-94b17afed3d4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:42 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0691dd59-90a8-47a2-b124-ff2ef22e4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-025973b6-b8a3-47c9-90af-f2752dc506e9" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-quobyte-025973b6-b8a3-47c9-90af-f2752dc506e9" released by "delete_volume" :: held 0.867s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Volume volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 (9d143353-2ab4-40df-8d3e-94b17afed3d4): created successfully Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0691dd59-90a8-47a2-b124-ff2ef22e4e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (56cba3a9-dfc5-4797-bf1e-ee554e44a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-36da83fe-bb76-4807-ba01-ca6adf82bae7 tempest-VolumesListTestJSON-2096307790 None] Created volume successfully. Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Created reservations ['768d2971-c270-4577-bc2c-eba45193df0f', '469668cc-ad25-430e-886e-8ca55155b571', '43896778-542f-431e-a5c2-282e2ce00fed', 'ac9ec914-654b-4dc1-8823-c485c6198233'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:42 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:42 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:42 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.349s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:42 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Deleted volume successfully. Aug 11 06:32:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b410eddd-0950-4b3f-940c-be591e2580ec tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-025973b6-b8a3-47c9-90af-f2752dc506e9-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-9b4caca5-6175-49c3-bfb6-f6967c00cc95 req-e46f4e30-c673-4421-aa5a-76438edd7337 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-9b4caca5-6175-49c3-bfb6-f6967c00cc95 req-e46f4e30-c673-4421-aa5a-76438edd7337 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-9b4caca5-6175-49c3-bfb6-f6967c00cc95 req-e46f4e30-c673-4421-aa5a-76438edd7337 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-9b4caca5-6175-49c3-bfb6-f6967c00cc95 req-e46f4e30-c673-4421-aa5a-76438edd7337 tempest-ServerActionsTestOtherA-1490261714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-8350146a-7f66-45c8-a6a9-409dff4f9817', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dd2dddb-4353-4040-b7fd-a9f6a475bd0e', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:32:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-9b4caca5-6175-49c3-bfb6-f6967c00cc95 req-e46f4e30-c673-4421-aa5a-76438edd7337 tempest-ServerActionsTestOtherA-1490261714 None] attachment_update completed successfully. Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (71896038-1b25-438f-9cf3-f547656da8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a141e3fb-3ea2-48b4-8fc4-d3cf41e97cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a141e3fb-3ea2-48b4-8fc4-d3cf41e97cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1437561096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e04d699-b2d0-41bf-b2c0-cbcc68edaf34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:44Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db734846-5cf7-4d1c-8587-b96954a1aa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db734846-5cf7-4d1c-8587-b96954a1aa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980e19b7-716c-46bd-913a-8e133ecb1b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980e19b7-716c-46bd-913a-8e133ecb1b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e04d699-b2d0-41bf-b2c0-cbcc68edaf34', 'volume_name': 'volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b5d3e9-591e-4511-8ae1-971f6587d7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b5d3e9-591e-4511-8ae1-971f6587d7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55221263-a11d-495e-9dd7-5bf6d77935a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Volume 7e04d699-b2d0-41bf-b2c0-cbcc68edaf34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34', 'volume_size': 1} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1437561096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e04d699-b2d0-41bf-b2c0-cbcc68edaf34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ee52dbc073a465385fded8ec343a43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:44Z,use_quota=True,user_id='6a1ec05d2b1b4036bd5d8bc79d81691b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Creating volume 7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:44 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:44 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 1073741824 Aug 11 06:32:44 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Flow 'volume_create_manager' (f87c7110-2449-4d84-ac45-0590bd3ad492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893db247-1e00-4e22-9fc5-8c01423e1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893db247-1e00-4e22-9fc5-8c01423e1724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429242961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52734722-60dd-4383-8236-8e9989d99903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686d1f796b7d4bb6b99cee3b743a1835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:45Z,use_quota=True,user_id='231d37320bd14aa4960f94259aa502a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fe1f41-ed6a-4795-b21d-ea31ab40ddb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fe1f41-ed6a-4795-b21d-ea31ab40ddb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad9533a-9284-4c41-b8d9-85abe36f8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad9533a-9284-4c41-b8d9-85abe36f8e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52734722-60dd-4383-8236-8e9989d99903', 'volume_name': 'volume-52734722-60dd-4383-8236-8e9989d99903', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a48d9f2-bee6-4bc8-964e-e46b899877ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a48d9f2-bee6-4bc8-964e-e46b899877ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6304de36-da27-45ec-b743-8cb6394d5280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Volume 52734722-60dd-4383-8236-8e9989d99903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52734722-60dd-4383-8236-8e9989d99903', 'volume_size': 1} Aug 11 06:32:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:45 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 1073741824" returned: 0 in 0.613s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:45 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 Aug 11 06:32:45 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:45 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" returned: 0 in 0.362s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429242961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52734722-60dd-4383-8236-8e9989d99903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686d1f796b7d4bb6b99cee3b743a1835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:45Z,use_quota=True,user_id='231d37320bd14aa4960f94259aa502a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Creating volume 52734722-60dd-4383-8236-8e9989d99903 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:45 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:45 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 1073741824 Aug 11 06:32:45 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55221263-a11d-495e-9dd7-5bf6d77935a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ef4cb-5a33-4ac7-992a-32e80cbc6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Volume volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 (7e04d699-b2d0-41bf-b2c0-cbcc68edaf34): created successfully Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175ef4cb-5a33-4ac7-992a-32e80cbc6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Flow 'volume_create_manager' (71896038-1b25-438f-9cf3-f547656da8b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-49d642b4-701e-43f0-a0a1-6946a4e912f9 tempest-VolumesListTestJSON-2096307790 None] Created volume successfully. Aug 11 06:32:46 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 1073741824" returned: 0 in 0.601s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:46 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 Aug 11 06:32:46 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:46 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903" returned: 0 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6304de36-da27-45ec-b743-8cb6394d5280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52734722-60dd-4383-8236-8e9989d99903', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab3ec5e-22ae-4afe-a697-07a3475f56bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Volume volume-52734722-60dd-4383-8236-8e9989d99903 (52734722-60dd-4383-8236-8e9989d99903): created successfully Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab3ec5e-22ae-4afe-a697-07a3475f56bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Flow 'volume_create_manager' (f87c7110-2449-4d84-ac45-0590bd3ad492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-77019037-0d96-48e7-a0e5-4e8094d5fa81 tempest-VolumesTransfersV357Test-217497913 None] Created volume successfully. Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "cinder-52734722-60dd-4383-8236-8e9989d99903-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-52734722-60dd-4383-8236-8e9989d99903-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "cinder-quobyte-52734722-60dd-4383-8236-8e9989d99903" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-quobyte-52734722-60dd-4383-8236-8e9989d99903" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d42ff-11db-4d46-9fbb-96a913becfd3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:48 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 Aug 11 06:32:48 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:32:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Flow 'volume_create_manager' (89c27341-dca8-4f96-8db7-a97ec4c4ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409b6c86-aebd-48e5-8dc4-051c5bf2feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409b6c86-aebd-48e5-8dc4-051c5bf2feef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1074208587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02d7ad-b382-44e4-980a-70ceb3333cac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2934ce35528478bbb84473f02ad8325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:49Z,use_quota=True,user_id='3a498526410f45178913d003fae7cd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7bfccb-eaa4-48ac-b194-b72c218597ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7bfccb-eaa4-48ac-b194-b72c218597ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc80fa87-9376-436b-9cff-00551c2dd3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc80fa87-9376-436b-9cff-00551c2dd3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b02d7ad-b382-44e4-980a-70ceb3333cac', 'volume_name': 'volume-6b02d7ad-b382-44e4-980a-70ceb3333cac', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9a61d3-99c8-426a-b5a7-eb02024251ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe9a61d3-99c8-426a-b5a7-eb02024251ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e81766-9157-4a5a-a312-79ac717140e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Volume 6b02d7ad-b382-44e4-980a-70ceb3333cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b02d7ad-b382-44e4-980a-70ceb3333cac', 'volume_size': 1} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1074208587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b02d7ad-b382-44e4-980a-70ceb3333cac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2934ce35528478bbb84473f02ad8325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:32:49Z,use_quota=True,user_id='3a498526410f45178913d003fae7cd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Creating volume 6b02d7ad-b382-44e4-980a-70ceb3333cac {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:32:49 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:49 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac 1073741824 Aug 11 06:32:49 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:49 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:49 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903 Aug 11 06:32:49 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:49 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-52734722-60dd-4383-8236-8e9989d99903" returned: 0 in 0.372s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-quobyte-52734722-60dd-4383-8236-8e9989d99903" released by "delete_volume" :: held 1.004s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Created reservations ['773d7f21-7fe5-40f9-ad0a-1340a81b3764', '714a846b-7214-4ec2-bc79-dd245e5fde53', '18a9d722-35e9-494b-b41a-867cd7f78713', 'd8eb861c-23b4-4453-a031-f0240f89fbf6'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:49 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac 1073741824" returned: 0 in 0.689s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:49 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:49 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:49 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac Aug 11 06:32:49 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-quobyte-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e29520-8c9e-4457-a831-6495430ff82a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:50 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 Aug 11 06:32:50 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:50 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.349s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Deleted volume successfully. Aug 11 06:32:50 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e500bb8f-7326-4659-b394-9ce68593a131 tempest-VolumesTransfersV357Test-65495657 None] Lock "cinder-52734722-60dd-4383-8236-8e9989d99903-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e81766-9157-4a5a-a312-79ac717140e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b02d7ad-b382-44e4-980a-70ceb3333cac', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179766cc-4c18-4109-986d-54408b1b6801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:32:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Volume volume-6b02d7ad-b382-44e4-980a-70ceb3333cac (6b02d7ad-b382-44e4-980a-70ceb3333cac): created successfully Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179766cc-4c18-4109-986d-54408b1b6801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Flow 'volume_create_manager' (89c27341-dca8-4f96-8db7-a97ec4c4ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:32:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-b481ad92-65e7-4a4e-9d87-eff4b5a455ab req-bee6f106-a05d-4c33-9a58-f8c09980ed6a tempest-VolumesGetTestJSON-428774170 None] Created volume successfully. Aug 11 06:32:50 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:50 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34 Aug 11 06:32:50 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:50 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" returned: 0 in 0.376s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34" released by "delete_volume" :: held 0.985s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Created reservations ['6f926c03-ff6e-4831-8d41-1c77cec9c016', '789a2ea7-9de9-4304-bec9-efbcf6412c7b', 'a9d99740-ac5f-4aa7-8816-2f0f5053105b', 'b621f72d-6900-4364-b8fe-5994af814a0a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:51 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:51 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Acquiring lock "cinder-6b02d7ad-b382-44e4-980a-70ceb3333cac-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "cinder-6b02d7ad-b382-44e4-980a-70ceb3333cac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Acquiring lock "cinder-quobyte-6b02d7ad-b382-44e4-980a-70ceb3333cac" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "cinder-quobyte-6b02d7ad-b382-44e4-980a-70ceb3333cac" acquired by "delete_volume" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:51 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9c245-09c4-4ab3-8795-8757057892c9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.411s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Deleted volume successfully. Aug 11 06:32:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17693334-589a-49e5-969a-cb69584bc932 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-7e04d699-b2d0-41bf-b2c0-cbcc68edaf34-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:51 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac Aug 11 06:32:51 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:52 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac" returned: 0 in 0.601s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:52 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac Aug 11 06:32:52 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-9d143353-2ab4-40df-8d3e-94b17afed3d4-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-9d143353-2ab4-40df-8d3e-94b17afed3d4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-quobyte-9d143353-2ab4-40df-8d3e-94b17afed3d4" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-9d143353-2ab4-40df-8d3e-94b17afed3d4" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41516a4-b22b-4c64-a477-886c700dad5f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:52 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 Aug 11 06:32:52 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:52 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6b02d7ad-b382-44e4-980a-70ceb3333cac" returned: 0 in 0.632s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "cinder-quobyte-6b02d7ad-b382-44e4-980a-70ceb3333cac" released by "delete_volume" :: held 1.310s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:52 devstack cinder-volume[94463]: DEBUG cinder.quota [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Created reservations ['4fb1606a-b143-4549-937a-ada24e92a515', '0aa210d5-5a6a-42e7-b4d2-3b8efc69e530', 'dee280ba-c15c-4245-9d7b-e3ae7d498450', 'b7e9bb0f-4b74-461c-b92f-f318642fc21d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:53 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:53 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:53 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4" returned: 0 in 0.729s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:53 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4 Aug 11 06:32:53 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:53 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.666s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG cinder.manager [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Deleted volume successfully. Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-34d1b3ab-ceee-4446-80f0-82a8b29fe472 req-602d59da-357d-4356-945d-1eb75cf4b426 tempest-VolumesGetTestJSON-428774170 None] Lock "cinder-6b02d7ad-b382-44e4-980a-70ceb3333cac-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:53 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9d143353-2ab4-40df-8d3e-94b17afed3d4" returned: 0 in 0.707s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-9d143353-2ab4-40df-8d3e-94b17afed3d4" released by "delete_volume" :: held 1.504s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Created reservations ['7259901a-da66-406a-8032-9bf974472189', '76d04676-b07b-481f-ab96-4eca05cef263', '083d50fa-1f87-43aa-97f9-acbe641eac67', '9831575e-0364-44b0-8097-909e5f9e1a66'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:54 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:54 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:54 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.510s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Deleted volume successfully. Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fdeb3bba-957e-4300-8db2-06912c48016c tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-9d143353-2ab4-40df-8d3e-94b17afed3d4-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-b1cb5415-0dd5-45c1-b52e-30dda24cfebb-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-b1cb5415-0dd5-45c1-b52e-30dda24cfebb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "cinder-quobyte-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef56b01-fa62-4778-a90e-98ef8a4d4351]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:55 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb Aug 11 06:32:55 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:55 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" returned: 0 in 0.634s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:55 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb Aug 11 06:32:55 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:56 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-quobyte-b1cb5415-0dd5-45c1-b52e-30dda24cfebb" released by "delete_volume" :: held 1.155s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Created reservations ['b3242701-a431-4545-ae4b-1775cbe8ea26', 'd199720b-44bd-4996-bd5e-f925c4f66165', '280c6fea-50db-4313-bc51-4b6ecc1dafd0', '27c32ee9-c947-47b9-8a45-973d271b9d92'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:32:56 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:32:56 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:32:56 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.490s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:32:56 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:32:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Deleted volume successfully. Aug 11 06:32:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0440a48e-a22b-4cc8-a12b-f1ea6f5a3cc3 tempest-VolumesListTestJSON-2096307790 None] Lock "cinder-b1cb5415-0dd5-45c1-b52e-30dda24cfebb-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Flow 'volume_create_manager' (40d48ba3-6ce7-4806-8c98-a5a354551df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e014be8b-88ec-4df9-9e1c-322e28f388b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e014be8b-88ec-4df9-9e1c-322e28f388b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1883896036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eeeb7ea-8d67-4c0d-8e16-5f1280514928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358ced042a814675830b5d2ac804fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:01Z,use_quota=True,user_id='8c185674851f4785b16d72821839539e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a40d91-ef08-46b6-9ed3-1373a9c23c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a40d91-ef08-46b6-9ed3-1373a9c23c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f91ac-c308-4da7-b740-5fbfeabd18c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f91ac-c308-4da7-b740-5fbfeabd18c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'volume_name': 'volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a89c70f-9e3a-458d-9367-84fd520c7767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a89c70f-9e3a-458d-9367-84fd520c7767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dc5e1e-645e-4428-8990-9769388b6387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Volume 4eeeb7ea-8d67-4c0d-8e16-5f1280514928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'volume_size': 1} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1883896036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eeeb7ea-8d67-4c0d-8e16-5f1280514928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358ced042a814675830b5d2ac804fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:01Z,use_quota=True,user_id='8c185674851f4785b16d72821839539e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Creating volume 4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:01 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:01 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 1073741824 Aug 11 06:33:01 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:02 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 1073741824" returned: 0 in 0.745s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:02 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:02 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:02 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.568s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dc5e1e-645e-4428-8990-9769388b6387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66214a14-a25a-457c-afb8-25b60f2648b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Volume volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 (4eeeb7ea-8d67-4c0d-8e16-5f1280514928): created successfully Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66214a14-a25a-457c-afb8-25b60f2648b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Flow 'volume_create_manager' (40d48ba3-6ce7-4806-8c98-a5a354551df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7cc6c09d-a570-4b17-a509-ab0d1c7b55bc tempest-VolumesCloneTest-939900023 None] Created volume successfully. Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-922722f4-fc6b-44ce-9fcb-317ed3befebd tempest-GroupsTest-549603532 None] Group tempest-Group1-925324617: creating Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-922722f4-fc6b-44ce-9fcb-317ed3befebd tempest-GroupsTest-549603532 None] Group tempest-Group1-925324617: created successfully Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-922722f4-fc6b-44ce-9fcb-317ed3befebd tempest-GroupsTest-549603532 None] Create group completed successfully. Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Flow 'volume_create_manager' (23f21ab4-f939-4f7f-810d-b19b48c0cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84f2d69-ae9e-4f78-acc5-666ed3ae55f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84f2d69-ae9e-4f78-acc5-666ed3ae55f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1931926870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9eb046b876458fa685c47c04443655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:04Z,use_quota=True,user_id='75ad6c6836d548dd98fef5e806ed278b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1b9779-d492-4c1c-bf8d-d25d54940d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1b9779-d492-4c1c-bf8d-d25d54940d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f3c738-d667-470e-8750-214880522417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f3c738-d667-470e-8750-214880522417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7', 'volume_name': 'volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7', 'volume_size': 2}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15118ecb-68ab-4faa-8292-b53fea8f50c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15118ecb-68ab-4faa-8292-b53fea8f50c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71bde72-eb74-4819-925f-a55fb5e6ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Volume ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7', 'volume_size': 2} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1931926870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9eb046b876458fa685c47c04443655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:04Z,use_quota=True,user_id='75ad6c6836d548dd98fef5e806ed278b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Creating volume ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 2147483648 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:03 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 2147483648 Aug 11 06:33:03 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Flow 'volume_create_manager' (5d469954-e639-48ed-97b6-12e746f87906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1122006b-4b03-4023-bf70-0fbfb1e4fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-779eb1e7-0f9e-4915-857b-e18a2fb127c9 tempest-ServerActionsTestOtherA-1490261714 None] Terminate volume connection completed successfully. Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-779eb1e7-0f9e-4915-857b-e18a2fb127c9 tempest-ServerActionsTestOtherA-1490261714 None] Deleting attachment 5dd2dddb-4353-4040-b7fd-a9f6a475bd0e. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1122006b-4b03-4023-bf70-0fbfb1e4fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1346243763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153da93f-1df7-45df-8b16-9bc05616e696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='358ced042a814675830b5d2ac804fdb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4eeeb7ea-8d67-4c0d-8e16-5f1280514928,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:04Z,use_quota=True,user_id='8c185674851f4785b16d72821839539e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62b1863-f692-42b2-ab9f-27994daf2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62b1863-f692-42b2-ab9f-27994daf2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f858249c-a595-47cf-af49-70aa604088ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f858249c-a595-47cf-af49-70aa604088ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '153da93f-1df7-45df-8b16-9bc05616e696', 'volume_name': 'volume-153da93f-1df7-45df-8b16-9bc05616e696', 'volume_size': 2, 'source_volid': '4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'source_volstatus': 'available'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa08e05-e3ab-4cdd-8308-35e1f865baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa08e05-e3ab-4cdd-8308-35e1f865baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7a00ca-a5be-4d47-9a1f-882dcc78efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Volume 153da93f-1df7-45df-8b16-9bc05616e696: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-153da93f-1df7-45df-8b16-9bc05616e696', 'volume_size': 2, 'source_volid': '4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'source_volstatus': 'available'} Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:04 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 2147483648" returned: 0 in 0.879s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b2df5c14-f0d3-4a52-8d78-93b35edac628 tempest-GroupsTest-549603532 None] Group tempest-Group2-99067255: creating Aug 11 06:33:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:04 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 Aug 11 06:33:04 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b2df5c14-f0d3-4a52-8d78-93b35edac628 tempest-GroupsTest-549603532 None] Group tempest-Group2-99067255: created successfully Aug 11 06:33:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b2df5c14-f0d3-4a52-8d78-93b35edac628 tempest-GroupsTest-549603532 None] Create group completed successfully. Aug 11 06:33:05 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.548s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:05 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Cloning volume 4eeeb7ea-8d67-4c0d-8e16-5f1280514928 to volume 153da93f-1df7-45df-8b16-9bc05616e696 Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71bde72-eb74-4819-925f-a55fb5e6ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7', 'volume_size': 2}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabdd2e6-60b7-4df4-9332-c3de1386f14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:05 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Volume volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 (ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7): created successfully Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabdd2e6-60b7-4df4-9332-c3de1386f14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Flow 'volume_create_manager' (23f21ab4-f939-4f7f-810d-b19b48c0cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Creating offline snapshot 849f839e-71c3-41db-8cb0-791c0d191f20 of volume 4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:33:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-59161112-8f93-4f19-8fe7-0eb38fdcc280 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Created volume successfully. Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee17ccd-e778-4d7a-8999-912a944de615]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:05 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:05 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:05 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:05 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 1G Aug 11 06:33:05 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:06 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 1G" returned: 0 in 0.626s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:06 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:06 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-95e2d7d2-a8f1-4a29-a6b6-293aefbc4389 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:06 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 is being set with open permissions: ugo+rw Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:06 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:06 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (b04526b3-6a1c-4e77-8151-6733bf8bbf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04080cdc-a11e-425f-8ce8-a6f6555b1850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04080cdc-a11e-425f-8ce8-a6f6555b1850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929748814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a46939e5-a7b4-4d95-9c47-eb6990cbe40e,host='devstack@QuobyteHD#QuobyteHD',id=4908d34e-4b3b-4f7e-ab8b-baa5dd048aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:07Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e11e7499-bcb3-40eb-91e2-a22927b66e6c),volume_type_id=e11e7499-bcb3-40eb-91e2-a22927b66e6c)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b217885-df2a-426c-93c0-6424b677a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b217885-df2a-426c-93c0-6424b677a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59096441-aa9d-43fa-9db9-170c06c218bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59096441-aa9d-43fa-9db9-170c06c218bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4908d34e-4b3b-4f7e-ab8b-baa5dd048aef', 'volume_name': 'volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4306ed38-89d0-400e-9048-bb3f5556b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4306ed38-89d0-400e-9048-bb3f5556b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f60e4f9-b37a-4123-90dd-6f9171526934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Volume 4908d34e-4b3b-4f7e-ab8b-baa5dd048aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef', 'volume_size': 1} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:06 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:06 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info Aug 11 06:33:06 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:07 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info" returned: 0 in 0.240s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:07 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info is being set with open permissions: ugo+rw Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:07 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info Aug 11 06:33:07 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:07 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.info" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] snapshot: 849f839e-71c3-41db-8cb0-791c0d191f20, volume: 153da93f-1df7-45df-8b16-9bc05616e696, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f40a2ab-81b0-421d-8269-f71fe9fd562b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:07 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:07 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:07 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56c5afe-f9f6-4edc-be72-cc9629469af3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:07 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:07 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:08 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:33:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:33:08 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:33:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:08 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 Aug 11 06:33:08 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:12 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696" returned: 0 in 4.180s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:33:12 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Converted 1024.00 MB image at 244.90 MB/s Aug 11 06:33:12 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 is being set with open permissions: ugo+rw Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:12 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 Aug 11 06:33:12 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:12 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696" returned: 0 in 0.227s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" released by "_copy_volume_from_snapshot" :: held 5.203s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-quobyte-849f839e-71c3-41db-8cb0-791c0d191f20" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-849f839e-71c3-41db-8cb0-791c0d191f20" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Deleting offline snapshot 849f839e-71c3-41db-8cb0-791c0d191f20 of volume 4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] snapshot_file for this snap is: volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1ce65-010a-4d95-969b-d98c3f4f49d4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:12 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:12 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:13 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.396s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b516f-213f-4e24-86b1-9b5bed01c9f9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:13 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:13 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:13 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.538s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:13 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:13 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:13 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:13 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20 Aug 11 06:33:13 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:14 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928.849f839e-71c3-41db-8cb0-791c0d191f20" returned: 0 in 0.238s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-849f839e-71c3-41db-8cb0-791c0d191f20" released by "_delete_snapshot" :: held 1.574s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=120,cinder:UPDATE=140,cinder:INSERT=40,cinder:DELETE=15 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=145,cinder:INSERT=37,cinder:SELECT=112,cinder:DELETE=10 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.149s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.096s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af7a00ca-a5be-4d47-9a1f-882dcc78efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153da93f-1df7-45df-8b16-9bc05616e696', 'volume_size': 2, 'source_volid': '4eeeb7ea-8d67-4c0d-8e16-5f1280514928', 'source_volstatus': 'available'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d929a5-07e5-4f77-9f97-905c3c2b50c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Creating offline snapshot f4c0c687-ed0b-4031-90c4-e1628cb0898c of volume ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:33:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Volume volume-153da93f-1df7-45df-8b16-9bc05616e696 (153da93f-1df7-45df-8b16-9bc05616e696): created successfully Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d929a5-07e5-4f77-9f97-905c3c2b50c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Flow 'volume_create_manager' (5d469954-e639-48ed-97b6-12e746f87906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f25a84b-c3bd-4b89-bcf6-b953c4911580]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0ff26a21-77d8-4aca-8b0f-03d37b02baca tempest-VolumesCloneTest-939900023 None] Created volume successfully. Aug 11 06:33:14 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 Aug 11 06:33:14 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:14 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c 2G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:14 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c 2G Aug 11 06:33:14 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-153da93f-1df7-45df-8b16-9bc05616e696-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "cinder-153da93f-1df7-45df-8b16-9bc05616e696-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90c042-f209-4861-b4c2-0359585783e5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 Aug 11 06:33:15 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:15 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c 2G" returned: 0 in 0.479s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c Aug 11 06:33:15 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696 Aug 11 06:33:15 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.292s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:33:15 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c" returned: 0 in 0.300s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c is being set with open permissions: ugo+rw Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-153da93f-1df7-45df-8b16-9bc05616e696" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c Aug 11 06:33:15 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-153da93f-1df7-45df-8b16-9bc05616e696" released by "delete_volume" :: held 0.710s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Created reservations ['cf07e3e7-94ea-420e-b8d9-10695313289c', '5f0b6464-7bc8-4334-888e-9c0f5101ae56', '45446152-08fe-4412-8bba-ba9a05082dae', '17eb3e60-eec3-4979-8dce-e6b423823404'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:15 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:15 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:15 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info Aug 11 06:33:15 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:16 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-4eeeb7ea-8d67-4c0d-8e16-5f1280514928-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Deleted volume successfully. Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "cinder-4eeeb7ea-8d67-4c0d-8e16-5f1280514928-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c180011-1912-4c67-8857-9cb1c5bd5536 tempest-VolumesCloneTest-939900023 None] Lock "cinder-153da93f-1df7-45df-8b16-9bc05616e696-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Acquiring lock "cinder-quobyte-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:16 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info" returned: 0 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:16 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info is being set with open permissions: ugo+rw Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb298d-93f8-41fc-a873-d368d2ec6ab9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:16 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info Aug 11 06:33:16 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:16 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:16 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:16 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.info" returned: 0 in 0.269s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-95e2d7d2-a8f1-4a29-a6b6-293aefbc4389 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.117s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-95e2d7d2-a8f1-4a29-a6b6-293aefbc4389 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.811s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a46939e5-a7b4-4d95-9c47-eb6990cbe40e,created_at=2026-08-11T04:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929748814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a46939e5-a7b4-4d95-9c47-eb6990cbe40e,host='devstack@QuobyteHD#QuobyteHD',id=4908d34e-4b3b-4f7e-ab8b-baa5dd048aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:07Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e11e7499-bcb3-40eb-91e2-a22927b66e6c),volume_type_id=e11e7499-bcb3-40eb-91e2-a22927b66e6c)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Creating volume 4908d34e-4b3b-4f7e-ab8b-baa5dd048aef {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:16 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a8a8f84e-2a63-4e04-9cde-6e740350e0e4 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Create snapshot completed successfully Aug 11 06:33:16 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef 1073741824 Aug 11 06:33:16 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:16 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-95e2d7d2-a8f1-4a29-a6b6-293aefbc4389 tempest-ServerActionsTestOtherA-1490261714 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-8350146a-7f66-45c8-a6a9-409dff4f9817', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a0a0119-2e21-49fb-8549-90f962d1cc9b', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:33:16 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928 Aug 11 06:33:16 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-6835dd10-1909-4355-b33f-98c2c884b7ab req-95e2d7d2-a8f1-4a29-a6b6-293aefbc4389 tempest-ServerActionsTestOtherA-1490261714 None] attachment_update completed successfully. Aug 11 06:33:16 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" returned: 0 in 0.321s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "cinder-quobyte-4eeeb7ea-8d67-4c0d-8e16-5f1280514928" released by "delete_volume" :: held 0.766s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "cinder-f4c0c687-ed0b-4031-90c4-e1628cb0898c-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Created reservations ['11a51fb1-99e1-4198-8582-8a74a0768e58', 'c207b76f-6d53-4610-b053-ac08c2ef1a5e', '5d0a3d73-9dde-4d8b-a401-0662d5ba6c98', 'cdb32c6b-8a83-4185-9720-64af2f99c5a0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-f4c0c687-ed0b-4031-90c4-e1628cb0898c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "cinder-quobyte-f4c0c687-ed0b-4031-90c4-e1628cb0898c" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-f4c0c687-ed0b-4031-90c4-e1628cb0898c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Deleting offline snapshot f4c0c687-ed0b-4031-90c4-e1628cb0898c of volume ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] snapshot_file for this snap is: volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[adecfa58-5808-46ea-8e35-3eb168ec93c0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:17 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef 1073741824" returned: 0 in 0.626s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:17 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:17 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:17 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c Aug 11 06:33:17 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:17 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef Aug 11 06:33:17 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:17 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.627s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Deleted volume successfully. Aug 11 06:33:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-548cc2fd-de93-4602-afc8-a5fcc82a8538 tempest-VolumesCloneTest-939900023 None] Lock "cinder-4eeeb7ea-8d67-4c0d-8e16-5f1280514928-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:18 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" returned: 0 in 0.700s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:18 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f60e4f9-b37a-4123-90dd-6f9171526934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cf055f-78e9-4228-87e6-545aa1b31f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c" returned: 0 in 0.902s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:33:18 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Volume volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef (4908d34e-4b3b-4f7e-ab8b-baa5dd048aef): created successfully Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cf055f-78e9-4228-87e6-545aa1b31f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (b04526b3-6a1c-4e77-8151-6733bf8bbf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1bcd27-c1c3-417b-b784-37990dbac0c7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2d2ea1d4-8524-4fae-bf38-138d933ed07d tempest-GroupsTest-549603532 None] Created volume successfully. Aug 11 06:33:18 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 Aug 11 06:33:18 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:18 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" returned: 0 in 0.491s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:18 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c Aug 11 06:33:18 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:19 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:19 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c Aug 11 06:33:19 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:19 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7.f4c0c687-ed0b-4031-90c4-e1628cb0898c" returned: 0 in 0.299s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-f4c0c687-ed0b-4031-90c4-e1628cb0898c" released by "_delete_snapshot" :: held 2.386s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" released by "delete_snapshot" :: held 2.427s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Created reservations ['ed51e431-6592-4607-9bbb-d1ac23a8bced', 'd69129cc-e812-411c-a8ef-8d8627fa5609', '62e21962-5bd7-4ad5-8426-76202f8f3a47', '782be09e-647a-4542-99c6-d7c3b11e1771'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Delete snapshot completed successfully. Aug 11 06:33:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-852c9123-6f4e-4e31-a753-bcb6ffb9a339 tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-f4c0c687-ed0b-4031-90c4-e1628cb0898c-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Acquiring lock "cinder-quobyte-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1811573-25df-4e4e-b5bf-53b1b97db1e1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "cinder-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" acquired by "delete_volume" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:20 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef Aug 11 06:33:20 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b987fd6-e94a-47b9-9be7-8cc4db0057a4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:21 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 Aug 11 06:33:21 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:21 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" returned: 0 in 0.718s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:21 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef Aug 11 06:33:21 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:21 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:21 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" returned: 0 in 0.766s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-4908d34e-4b3b-4f7e-ab8b-baa5dd048aef" released by "delete_volume" :: held 1.117s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:21 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7 Aug 11 06:33:21 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Created reservations ['7cbf627c-6f71-4529-a16f-fe1ebf77d139'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:21 devstack cinder-volume[94463]: WARNING cinder.quota [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1678158631 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1678158631, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:33:21 devstack cinder-volume[94463]: WARNING cinder.quota [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1678158631 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1678158631, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Created reservations ['109b5c84-2e85-4d7b-ab83-8f6daef5eeee', 'd192c0e8-c3d2-408b-ad63-4f01c575e1b1', '04aa12b2-ddee-42fa-b24e-c733f1be3b98', '082e2f21-c349-40b4-b7bb-178762c4d880'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:21 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" returned: 0 in 0.513s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:21 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:22 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-quobyte-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7" released by "delete_volume" :: held 1.451s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Created reservations ['7c7278a9-0e56-4c64-a504-19150314b97f', 'facc6d40-1b44-4f44-a959-bbeff0919912', '5ecc6b98-9277-4fa0-a403-ad945ae29560', '3df2fe4e-e945-4c88-8eab-45182693d5c1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:22 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:22 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Flow 'volume_create_manager' (aa266bb5-dc23-4f2d-b1ce-23bbbb6dfad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c58bab0-e99f-4ec1-bc0f-2a33a516f9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:22 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.433s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ff9bbfc7-8794-4eb7-b710-f028c76d5ded tempest-GroupsTest-549603532 None] Delete group completed successfully. Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c58bab0-e99f-4ec1-bc0f-2a33a516f9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-576501675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d696cb-dd86-464c-a7bf-007ff5a931cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ddd3711c4f457cb001a693ac4f483f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:22Z,use_quota=True,user_id='b9e63f22a663462693f0c35785d8f006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb49e94-2057-4740-b79c-4b5ce02df23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfb49e94-2057-4740-b79c-4b5ce02df23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc99ddf7-34f0-436d-b707-6c52d9ceea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc99ddf7-34f0-436d-b707-6c52d9ceea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d696cb-dd86-464c-a7bf-007ff5a931cc', 'volume_name': 'volume-29d696cb-dd86-464c-a7bf-007ff5a931cc', 'volume_size': 2}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1264bc2f-3754-47a0-a54d-74d2a94bec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1264bc2f-3754-47a0-a54d-74d2a94bec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d05772-7d37-4685-85fd-0d929bc2bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:22 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Volume 29d696cb-dd86-464c-a7bf-007ff5a931cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d696cb-dd86-464c-a7bf-007ff5a931cc', 'volume_size': 2} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-576501675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d696cb-dd86-464c-a7bf-007ff5a931cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ddd3711c4f457cb001a693ac4f483f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:22Z,use_quota=True,user_id='b9e63f22a663462693f0c35785d8f006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Creating volume 29d696cb-dd86-464c-a7bf-007ff5a931cc {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:22 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc 2147483648 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:22 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc 2147483648 Aug 11 06:33:22 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:22 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Deleted volume successfully. Aug 11 06:33:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6a6733a1-ccfa-40a5-860a-39efd31adf4c tempest-VolumesSnapshotNegativeTestJSON-1637218057 None] Lock "cinder-ba8f86d7-8e5d-4ec4-b3c8-3d58ae2c68e7-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Created reservations ['c7d701c5-ff1b-4c07-97d2-247a40420639'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:23 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc 2147483648" returned: 0 in 0.861s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:23 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:23 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:23 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc Aug 11 06:33:23 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:23 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-08bd3523-7574-4535-8052-eac6977a6586 tempest-GroupsTest-549603532 None] Delete group completed successfully. Aug 11 06:33:23 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc" returned: 0 in 0.409s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d05772-7d37-4685-85fd-0d929bc2bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d696cb-dd86-464c-a7bf-007ff5a931cc', 'volume_size': 2}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0902383d-cf46-4e37-aba9-e9ad6c7a041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Volume volume-29d696cb-dd86-464c-a7bf-007ff5a931cc (29d696cb-dd86-464c-a7bf-007ff5a931cc): created successfully Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0902383d-cf46-4e37-aba9-e9ad6c7a041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Flow 'volume_create_manager' (aa266bb5-dc23-4f2d-b1ce-23bbbb6dfad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-487b5f33-8f7d-42be-b564-41444ef70dfe tempest-VolumesCloneNegativeTest-1362562941 None] Created volume successfully. Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Acquiring lock "cinder-29d696cb-dd86-464c-a7bf-007ff5a931cc-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "cinder-29d696cb-dd86-464c-a7bf-007ff5a931cc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Acquiring lock "cinder-quobyte-29d696cb-dd86-464c-a7bf-007ff5a931cc" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "cinder-quobyte-29d696cb-dd86-464c-a7bf-007ff5a931cc" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b932664-3e4f-4beb-a29d-73f501d2ecd9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:25 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc Aug 11 06:33:25 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-093a1de4-db4d-498f-a83f-f096a9e69f20 tempest-GroupsTest-549603532 None] Group tempest-GroupsTest-Group-1879025801: creating Aug 11 06:33:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-093a1de4-db4d-498f-a83f-f096a9e69f20 tempest-GroupsTest-549603532 None] Group tempest-GroupsTest-Group-1879025801: created successfully Aug 11 06:33:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-093a1de4-db4d-498f-a83f-f096a9e69f20 tempest-GroupsTest-549603532 None] Create group completed successfully. Aug 11 06:33:25 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc" returned: 0 in 0.693s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:25 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc Aug 11 06:33:25 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:25 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-29d696cb-dd86-464c-a7bf-007ff5a931cc" returned: 0 in 0.325s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "cinder-quobyte-29d696cb-dd86-464c-a7bf-007ff5a931cc" released by "delete_volume" :: held 1.126s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Created reservations ['d2999e41-ae70-4d14-aa61-b347350bd2d4', 'd8b6d126-95ef-4e1c-a0ac-00c0dbbdb9fd', '80789488-5d00-47f5-ac89-4a664e9d93f6', 'f166f6a3-9c1f-45df-b053-2059e64de881'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:26 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:26 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:26 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Deleted volume successfully. Aug 11 06:33:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1088f262-28f8-4548-ba97-d9d612415923 tempest-VolumesCloneNegativeTest-1362562941 None] Lock "cinder-29d696cb-dd86-464c-a7bf-007ff5a931cc-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (2ac6f5ae-7c3d-418d-bc72-b40db0566749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3225177-88ba-4f75-ac75-2275630804f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3225177-88ba-4f75-ac75-2275630804f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261587704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,host='devstack@QuobyteHD#QuobyteHD',id=02b72e2c-9299-45ab-8433-62afee59046f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:27Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a21ad6c8-7213-433c-ab81-42332a0db97c),volume_type_id=a21ad6c8-7213-433c-ab81-42332a0db97c)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10d5c0c-591f-4711-9cc2-64d9b3ad7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a10d5c0c-591f-4711-9cc2-64d9b3ad7efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d4223-5fd1-4d4f-bcf7-7515f8289cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9d4223-5fd1-4d4f-bcf7-7515f8289cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b72e2c-9299-45ab-8433-62afee59046f', 'volume_name': 'volume-02b72e2c-9299-45ab-8433-62afee59046f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f803043-de65-4ae3-abf5-dc912fedfefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f803043-de65-4ae3-abf5-dc912fedfefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccee53cd-61a2-49cd-8201-f5aa0094918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Volume 02b72e2c-9299-45ab-8433-62afee59046f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b72e2c-9299-45ab-8433-62afee59046f', 'volume_size': 1} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,created_at=2026-08-11T04:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261587704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,host='devstack@QuobyteHD#QuobyteHD',id=02b72e2c-9299-45ab-8433-62afee59046f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:27Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a21ad6c8-7213-433c-ab81-42332a0db97c),volume_type_id=a21ad6c8-7213-433c-ab81-42332a0db97c)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Creating volume 02b72e2c-9299-45ab-8433-62afee59046f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:27 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:27 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f 1073741824 Aug 11 06:33:27 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:28 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f 1073741824" returned: 0 in 0.579s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:28 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f Aug 11 06:33:28 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:28 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccee53cd-61a2-49cd-8201-f5aa0094918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b72e2c-9299-45ab-8433-62afee59046f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a88b6-cc3d-4d63-ae3d-ce26355ef808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Volume volume-02b72e2c-9299-45ab-8433-62afee59046f (02b72e2c-9299-45ab-8433-62afee59046f): created successfully Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8a88b6-cc3d-4d63-ae3d-ce26355ef808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (2ac6f5ae-7c3d-418d-bc72-b40db0566749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0433c56b-5a93-4b3f-ad3c-6e5d400605ec tempest-GroupsTest-549603532 None] Created volume successfully. Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (4d537ae6-c4c7-4d97-a78c-ef1e621d4a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a0c02-d07a-4e23-9c5e-cb7688b54c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a0c02-d07a-4e23-9c5e-cb7688b54c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123299158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,host='devstack@QuobyteHD#QuobyteHD',id=b7c895f1-dc6e-4cb8-a9ab-08682b68abfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:30Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a21ad6c8-7213-433c-ab81-42332a0db97c),volume_type_id=a21ad6c8-7213-433c-ab81-42332a0db97c)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f21fbb-d118-4573-8064-1ff74f813a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f21fbb-d118-4573-8064-1ff74f813a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed641c-1cc5-4e8a-9119-c889e4371492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ed641c-1cc5-4e8a-9119-c889e4371492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c895f1-dc6e-4cb8-a9ab-08682b68abfd', 'volume_name': 'volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95387d5e-1de5-4100-9350-8efecff941cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95387d5e-1de5-4100-9350-8efecff941cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f48e3b-d025-4d09-bee0-78f8761c6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:30 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Volume b7c895f1-dc6e-4cb8-a9ab-08682b68abfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd', 'volume_size': 1} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,created_at=2026-08-11T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123299158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ffea26d-a5aa-423d-8a4b-563aa21fe4fb,host='devstack@QuobyteHD#QuobyteHD',id=b7c895f1-dc6e-4cb8-a9ab-08682b68abfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9fe31b288fd4fa48a44f67e6ae150bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:30Z,use_quota=True,user_id='e03eb07117e84867a6b083cbdc5bf29d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a21ad6c8-7213-433c-ab81-42332a0db97c),volume_type_id=a21ad6c8-7213-433c-ab81-42332a0db97c)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Creating volume b7c895f1-dc6e-4cb8-a9ab-08682b68abfd {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:30 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:30 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd 1073741824 Aug 11 06:33:30 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:31 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd 1073741824" returned: 0 in 0.654s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:31 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd Aug 11 06:33:31 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (22adf4a6-9b69-44da-894b-70a0d6dccdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25442ccb-2074-4a73-9d2d-93b0a7491cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25442ccb-2074-4a73-9d2d-93b0a7491cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1049506960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a3985e-2ab7-46c8-a792-52b464ed7d3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:32Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3ae2a-e40f-425b-abd2-950e82a9fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3ae2a-e40f-425b-abd2-950e82a9fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338734b5-0e65-4b7c-90e2-b8ab03336ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338734b5-0e65-4b7c-90e2-b8ab03336ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a3985e-2ab7-46c8-a792-52b464ed7d3f', 'volume_name': 'volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de337a3c-bcda-4514-9a09-342b1f87afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de337a3c-bcda-4514-9a09-342b1f87afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccadfc27-3d67-447b-b1ab-4e8592fd8001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Volume 38a3985e-2ab7-46c8-a792-52b464ed7d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f', 'volume_size': 1} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:31 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.035s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1049506960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a3985e-2ab7-46c8-a792-52b464ed7d3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:32Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Creating volume 38a3985e-2ab7-46c8-a792-52b464ed7d3f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:31 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f48e3b-d025-4d09-bee0-78f8761c6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f 1073741824 Aug 11 06:33:31 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd883ce-6f0d-44de-adc1-943d06753f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Volume volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd (b7c895f1-dc6e-4cb8-a9ab-08682b68abfd): created successfully Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd883ce-6f0d-44de-adc1-943d06753f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Flow 'volume_create_manager' (4d537ae6-c4c7-4d97-a78c-ef1e621d4a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-adc0d848-63a2-4cfd-8d5a-ec20fc04363d tempest-GroupsTest-549603532 None] Created volume successfully. Aug 11 06:33:32 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f 1073741824" returned: 0 in 0.547s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:32 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f Aug 11 06:33:32 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:32 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccadfc27-3d67-447b-b1ab-4e8592fd8001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574806ae-f8ba-4eea-9758-882d317c8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Volume volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f (38a3985e-2ab7-46c8-a792-52b464ed7d3f): created successfully Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574806ae-f8ba-4eea-9758-882d317c8702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (22adf4a6-9b69-44da-894b-70a0d6dccdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7e43a397-99b0-4625-9ee2-8d5ebfdc8c04 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:33:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-588a0e20-c820-44af-b0cc-70e13f84fa87 tempest-GroupsTest-549603532 None] Update group completed successfully. Aug 11 06:33:34 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (eeca2878-849c-4b65-b7b2-6ddc53f821f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1e285e-be01-42bf-b7bf-6aa7ab882dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1e285e-be01-42bf-b7bf-6aa7ab882dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989287318',display_name='tempest-VolumesGetTest-Volume-2065717949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f558c7f8-b777-426e-ac13-8700cb33f10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:35Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16de339-e39b-4e98-a56f-7188f680e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16de339-e39b-4e98-a56f-7188f680e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf6da83-b579-4031-8069-bd0547dddaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf6da83-b579-4031-8069-bd0547dddaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f558c7f8-b777-426e-ac13-8700cb33f10c', 'volume_name': 'volume-f558c7f8-b777-426e-ac13-8700cb33f10c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d65455d-ab22-4861-bae7-6d862690f713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d65455d-ab22-4861-bae7-6d862690f713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2a877-a3fb-4021-840e-d30728fa77af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:35 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Volume f558c7f8-b777-426e-ac13-8700cb33f10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f558c7f8-b777-426e-ac13-8700cb33f10c', 'volume_size': 1} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989287318',display_name='tempest-VolumesGetTest-Volume-2065717949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f558c7f8-b777-426e-ac13-8700cb33f10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:35Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Creating volume f558c7f8-b777-426e-ac13-8700cb33f10c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:35 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:35 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c 1073741824 Aug 11 06:33:35 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7dc0ea93-f740-4adf-b761-6ba14c7e7bc4 tempest-GroupsTest-549603532 None] Update group completed successfully. Aug 11 06:33:35 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c 1073741824" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:35 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c Aug 11 06:33:35 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:36 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c" returned: 0 in 0.349s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2a877-a3fb-4021-840e-d30728fa77af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f558c7f8-b777-426e-ac13-8700cb33f10c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9176c171-7c48-4cbd-83c5-3c717009ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:36 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Volume volume-f558c7f8-b777-426e-ac13-8700cb33f10c (f558c7f8-b777-426e-ac13-8700cb33f10c): created successfully Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9176c171-7c48-4cbd-83c5-3c717009ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (eeca2878-849c-4b65-b7b2-6ddc53f821f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:36 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0d462dc9-5d2f-432b-9221-fc38a647f4f6 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Acquiring lock "cinder-quobyte-02b72e2c-9299-45ab-8433-62afee59046f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-02b72e2c-9299-45ab-8433-62afee59046f" acquired by "delete_volume" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a45b42-fbc0-493e-b4f0-65d3ce0c3da5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:37 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f Aug 11 06:33:37 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-f558c7f8-b777-426e-ac13-8700cb33f10c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-f558c7f8-b777-426e-ac13-8700cb33f10c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-f558c7f8-b777-426e-ac13-8700cb33f10c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-f558c7f8-b777-426e-ac13-8700cb33f10c" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[68307f22-5afd-44ff-8271-144eeca63c37]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:37 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f" returned: 0 in 0.522s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:37 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f Aug 11 06:33:37 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:37 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c Aug 11 06:33:37 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:37 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-02b72e2c-9299-45ab-8433-62afee59046f" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:37 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c" returned: 0 in 0.474s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-02b72e2c-9299-45ab-8433-62afee59046f" released by "delete_volume" :: held 0.999s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Acquiring lock "cinder-quobyte-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:37 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c Aug 11 06:33:37 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c680a-db58-49cc-b693-433062a3d4b2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:38 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd Aug 11 06:33:38 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:38 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f558c7f8-b777-426e-ac13-8700cb33f10c" returned: 0 in 0.446s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-f558c7f8-b777-426e-ac13-8700cb33f10c" released by "delete_volume" :: held 0.979s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Created reservations ['694f5e57-4a4d-4c06-8816-c5dbb2bdff36', '37e8269a-39f2-4371-8697-098560e12e23', '767799ee-d08b-4462-b79b-f936a00f5470', '86382a99-db8b-46ac-8cce-37740fcfd284'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:38 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:38 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:38 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:38 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:38 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:38 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" returned: 0 in 0.333s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "cinder-quobyte-b7c895f1-dc6e-4cb8-a9ab-08682b68abfd" released by "delete_volume" :: held 0.937s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:38 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.356s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e267bc8-b46a-43cf-bbdd-4319711a74c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-f558c7f8-b777-426e-ac13-8700cb33f10c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Created reservations ['6046b69f-3e1d-437c-9369-1041831991b8'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:38 devstack cinder-volume[94463]: WARNING cinder.quota [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-382612469 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-382612469, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:33:38 devstack cinder-volume[94463]: WARNING cinder.quota [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-382612469 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-382612469, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:33:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Created reservations ['c37e078b-3502-4672-bcb9-ae7982554283', 'a46d806e-a80d-46fb-9309-04591aedab05', 'b0526cb0-cfb4-4939-a429-8a3675883df9', 'f84f8d0d-83ce-4317-aa8d-daf824654bec'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Created reservations ['c16b3fcb-1493-4e37-a46d-7ffb007e95f9', '488d7911-35ce-4a8c-8523-b57ba8a17d30', 'b1256321-b14c-4e82-af1f-f5195cd90bc1', '346b1661-be2e-42a3-955f-71890bd2cacc'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:39 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:39 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:39 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3ee452db-4a1a-4328-855c-e01d93f29f47 tempest-GroupsTest-549603532 None] Delete group completed successfully. Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-38a3985e-2ab7-46c8-a792-52b464ed7d3f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "cinder-38a3985e-2ab7-46c8-a792-52b464ed7d3f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-38a3985e-2ab7-46c8-a792-52b464ed7d3f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-38a3985e-2ab7-46c8-a792-52b464ed7d3f" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[da67d4ea-be99-4c0e-8031-fc58d018531e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:39 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f Aug 11 06:33:39 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:40 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f" returned: 0 in 0.397s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:40 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f Aug 11 06:33:40 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:40 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-38a3985e-2ab7-46c8-a792-52b464ed7d3f" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-38a3985e-2ab7-46c8-a792-52b464ed7d3f" released by "delete_volume" :: held 0.776s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Created reservations ['c102f24b-f18a-4cb0-a797-39697063f030', 'a11afb07-673c-428d-ae67-772175f55fa8', '9b3380f3-cb39-4897-bc79-8da3041959e9', 'da25c26b-d94c-4e42-9e0e-a19a3a591f1b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:40 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:40 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:41 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.486s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-faa3d514-bc31-4a4d-812e-026618c69c45 tempest-VolumesGetTest-382793262 None] Lock "cinder-38a3985e-2ab7-46c8-a792-52b464ed7d3f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (8f35870e-05c5-4fa1-a58e-74b8d88824de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e45c09d-2062-4a51-9b71-677ca0f0f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e45c09d-2062-4a51-9b71-677ca0f0f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1431064894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec29e49-93cc-4c02-af59-fd9e79b70f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:42Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbe3566-185b-4d46-924b-33eb7ef0eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbe3566-185b-4d46-924b-33eb7ef0eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ccf3b1-d584-4a13-93b5-c545eb9485a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ccf3b1-d584-4a13-93b5-c545eb9485a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'volume_name': 'volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c2be1e-8404-4b20-817d-68bce8e02c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c2be1e-8404-4b20-817d-68bce8e02c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74dbc3d-4335-47ce-ab0e-4d97521e215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Volume 6ec29e49-93cc-4c02-af59-fd9e79b70f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'volume_size': 1} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1431064894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec29e49-93cc-4c02-af59-fd9e79b70f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:42Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Creating volume 6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:41 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:41 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a 1073741824 Aug 11 06:33:41 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:42 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a 1073741824" returned: 0 in 0.578s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:42 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:33:42 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:42 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74dbc3d-4335-47ce-ab0e-4d97521e215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c77af28-ba3d-441a-b553-421082ecbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Volume volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a (6ec29e49-93cc-4c02-af59-fd9e79b70f4a): created successfully Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c77af28-ba3d-441a-b553-421082ecbce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (8f35870e-05c5-4fa1-a58e-74b8d88824de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5cc27b36-d795-4605-a53a-4eb70bec8945 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (662dd63a-143d-4645-99e2-f3756fe07373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac99c6a0-d740-46b4-8be0-3e9fe28f94f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac99c6a0-d740-46b4-8be0-3e9fe28f94f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-265876877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c8a8db-28c0-41b8-bfdc-282e824d912b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6ec29e49-93cc-4c02-af59-fd9e79b70f4a,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:44Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa585b-05aa-4f1a-9be6-df8d05d57de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa585b-05aa-4f1a-9be6-df8d05d57de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4ddae0-b4f8-4cf7-988f-3f8608f6f130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4ddae0-b4f8-4cf7-988f-3f8608f6f130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b9c8a8db-28c0-41b8-bfdc-282e824d912b', 'volume_name': 'volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b', 'volume_size': 1, 'source_volid': '6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'source_volstatus': 'available'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77599dc-c7d6-40cb-a0a4-1c126ef98eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77599dc-c7d6-40cb-a0a4-1c126ef98eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a911ca2-7aef-4624-ab1a-f936d5f7d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Volume b9c8a8db-28c0-41b8-bfdc-282e824d912b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b', 'volume_size': 1, 'source_volid': '6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'source_volstatus': 'available'} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:44 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Cloning volume 6ec29e49-93cc-4c02-af59-fd9e79b70f4a to volume b9c8a8db-28c0-41b8-bfdc-282e824d912b Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Creating offline snapshot 12c8ca94-3279-4c9f-833b-13c19574d769 of volume 6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ca802-a6f9-4a6e-a359-e3d4a0d21096]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:44 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:33:44 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:45 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.435s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:45 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 1G Aug 11 06:33:45 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:45 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 1G" returned: 0 in 0.507s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:45 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:45 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:45 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:46 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 is being set with open permissions: ugo+rw Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:46 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:46 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Flow 'volume_create_manager' (a7572ce1-422c-434e-8f44-fe28690c5b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359313d4-717c-4a2f-a51e-f48632395677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359313d4-717c-4a2f-a51e-f48632395677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-198640279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bade0a6d-de9f-4481-b9b1-e8e79952f98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1a2d9efd2149f3b08882ac0d0de578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:46Z,use_quota=True,user_id='a2d1de8ea6ff4e528518fae753faaf81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e58354-0407-4525-baf8-456000c57576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e58354-0407-4525-baf8-456000c57576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05969ecc-7cbd-4fdc-99df-fcba37a35f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05969ecc-7cbd-4fdc-99df-fcba37a35f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bade0a6d-de9f-4481-b9b1-e8e79952f98d', 'volume_name': 'volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21abf148-55e9-4867-a1dd-15ab66b8ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21abf148-55e9-4867-a1dd-15ab66b8ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca752bd7-2219-415b-af8e-dbb3e201627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Volume bade0a6d-de9f-4481-b9b1-e8e79952f98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d', 'volume_size': 1} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:46 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.329s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:46 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info Aug 11 06:33:46 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:46 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:46 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info is being set with open permissions: ugo+rw Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:46 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info Aug 11 06:33:46 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:46 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.info" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] snapshot: 12c8ca94-3279-4c9f-833b-13c19574d769, volume: b9c8a8db-28c0-41b8-bfdc-282e824d912b, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e519a1-16e8-45ad-a718-105088443e9f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:47 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:47 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:47 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.460s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f391e0-95f4-41f7-9a65-d6564034c2c5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:47 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:33:47 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:47 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.417s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:33:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:33:48 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:33:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:48 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b Aug 11 06:33:48 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:53 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b" returned: 0 in 5.924s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:53 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:33:53 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Converted 1024.00 MB image at 172.81 MB/s Aug 11 06:33:53 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b is being set with open permissions: ugo+rw Aug 11 06:33:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:53 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b Aug 11 06:33:53 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:54 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b" returned: 0 in 0.296s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" released by "_copy_volume_from_snapshot" :: held 7.198s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-12c8ca94-3279-4c9f-833b-13c19574d769" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-12c8ca94-3279-4c9f-833b-13c19574d769" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Deleting offline snapshot 12c8ca94-3279-4c9f-833b-13c19574d769 of volume 6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] snapshot_file for this snap is: volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5467f7-4bed-46d2-b4bd-c2766fd94b24]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:54 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:54 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:54 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.494s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f1c9d6-9a6d-4a78-89d9-e550c2b7610f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-8c5b60ff-477a-4191-9d57-b64b3a86d8fa tempest-ServerActionsTestOtherA-1490261714 None] Terminate volume connection completed successfully. Aug 11 06:33:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-8c5b60ff-477a-4191-9d57-b64b3a86d8fa tempest-ServerActionsTestOtherA-1490261714 None] Deleting attachment 2a0a0119-2e21-49fb-8549-90f962d1cc9b. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:33:55 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:33:55 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "cinder-8350146a-7f66-45c8-a6a9-409dff4f9817-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-8350146a-7f66-45c8-a6a9-409dff4f9817-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "cinder-quobyte-8350146a-7f66-45c8-a6a9-409dff4f9817" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-quobyte-8350146a-7f66-45c8-a6a9-409dff4f9817" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9c2f2-a4e5-4c7a-9fd9-dad30f008311]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:55 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 Aug 11 06:33:55 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:55 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.653s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:55 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:55 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:55 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817" returned: 0 in 0.540s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:55 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817 Aug 11 06:33:55 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.528s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "cinder-0121db57-42b5-4a51-84da-8ce9731f9af7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:56 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769 Aug 11 06:33:56 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-0121db57-42b5-4a51-84da-8ce9731f9af7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "cinder-quobyte-0121db57-42b5-4a51-84da-8ce9731f9af7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-quobyte-0121db57-42b5-4a51-84da-8ce9731f9af7" acquired by "delete_volume" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad769bf-e90b-43f4-93ee-9bd13b2ad20d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:56 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8350146a-7f66-45c8-a6a9-409dff4f9817" returned: 0 in 0.429s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-quobyte-8350146a-7f66-45c8-a6a9-409dff4f9817" released by "delete_volume" :: held 1.022s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.quota [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Created reservations ['752d6bd3-2d22-4ba1-bd1e-865e0b0b8c48', 'cc0cab99-fc9e-45d3-9c44-802250b843ff', '8fce61e1-bf37-41f7-91b7-c08936366a3a', '5bb8a995-4895-4053-847b-dcd2ea6b2196'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:56 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 Aug 11 06:33:56 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:56 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a.12c8ca94-3279-4c9f-833b-13c19574d769" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:56 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:56 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-12c8ca94-3279-4c9f-833b-13c19574d769" released by "_delete_snapshot" :: held 2.185s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.962s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.299s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-198640279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bade0a6d-de9f-4481-b9b1-e8e79952f98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1a2d9efd2149f3b08882ac0d0de578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:46Z,use_quota=True,user_id='a2d1de8ea6ff4e528518fae753faaf81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Creating volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:33:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:56 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d 1073741824 Aug 11 06:33:56 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a911ca2-7aef-4624-ab1a-f936d5f7d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b', 'volume_size': 1, 'source_volid': '6ec29e49-93cc-4c02-af59-fd9e79b70f4a', 'source_volstatus': 'available'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb8349c-2f05-4c9f-800c-373d47b11562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Volume volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b (b9c8a8db-28c0-41b8-bfdc-282e824d912b): created successfully Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb8349c-2f05-4c9f-800c-373d47b11562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (662dd63a-143d-4645-99e2-f3756fe07373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-addf9b7c-4275-43cd-ae85-4ae3ba109b69 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:33:56 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7" returned: 0 in 0.531s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:56 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7 Aug 11 06:33:56 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:56 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.507s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.manager [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Deleted volume successfully. Aug 11 06:33:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-ebffe9c1-a5d6-4678-8e86-894ea72bf088 req-dd973554-a9eb-4040-ba99-be36d296d952 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-8350146a-7f66-45c8-a6a9-409dff4f9817-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:57 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0121db57-42b5-4a51-84da-8ce9731f9af7" returned: 0 in 0.326s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-quobyte-0121db57-42b5-4a51-84da-8ce9731f9af7" released by "delete_volume" :: held 0.903s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Created reservations ['12f9febc-62d0-4a75-8248-8ae84e8a9fd2', 'a9070ea5-8244-45c9-a75f-608092e874cd', '6c4876ea-935b-4dc4-bd6b-fa6698ea5a52', '941baf42-f379-40f0-9c03-762905ebfcab'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:33:57 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d 1073741824" returned: 0 in 0.632s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:57 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:33:57 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:57 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d Aug 11 06:33:57 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:57 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:33:57 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:33:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Deleted volume successfully. Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca752bd7-2219-415b-af8e-dbb3e201627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a6c674-50a0-4776-a90e-b0f6fe4b69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9c083578-f84f-4540-bb16-3fc99d5a51b8 tempest-ServerActionsTestOtherA-1490261714 None] Lock "cinder-0121db57-42b5-4a51-84da-8ce9731f9af7-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:33:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Volume volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d (bade0a6d-de9f-4481-b9b1-e8e79952f98d): created successfully Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a6c674-50a0-4776-a90e-b0f6fe4b69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Flow 'volume_create_manager' (a7572ce1-422c-434e-8f44-fe28690c5b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c14e09ab-23fa-46be-905f-c22eafa5e835 tempest-SnapshotsActionsTest-1210228608 None] Created volume successfully. Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Creating offline snapshot 832e9a65-6337-4855-84f1-f87ae3a80306 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad641af-60d2-415c-b137-7ce5df075954]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:33:58 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d Aug 11 06:33:58 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (16ee0114-f6da-498e-b9fd-ac43a34f2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3167cac9-2f9c-4c5d-a257-e9f6b7fa6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3167cac9-2f9c-4c5d-a257-e9f6b7fa6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1296102343',display_name='tempest-VolumesGetTest-Volume-1086352601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb186fc-d335-4cad-830d-07ea31e31a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:59Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df235ff6-e55f-4b66-bf09-e076481aff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df235ff6-e55f-4b66-bf09-e076481aff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcf64ca-4d39-490a-903d-ddacacecda15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbcf64ca-4d39-490a-903d-ddacacecda15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdb186fc-d335-4cad-830d-07ea31e31a49', 'volume_name': 'volume-bdb186fc-d335-4cad-830d-07ea31e31a49', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9126706-cc4f-45f4-a699-cc2e19d377c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9126706-cc4f-45f4-a699-cc2e19d377c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f267732-5265-4661-968e-8dbfaab211be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:33:59 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Volume bdb186fc-d335-4cad-830d-07ea31e31a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdb186fc-d335-4cad-830d-07ea31e31a49', 'volume_size': 1} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:33:59 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d" returned: 0 in 0.662s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:33:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:33:59 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 1G Aug 11 06:33:59 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:00 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 1G" returned: 0 in 0.683s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:00 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:00 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:00 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:00 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 is being set with open permissions: ugo+rw Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:00 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:00 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:00 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:00 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info Aug 11 06:34:00 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Flow 'volume_create_manager' (02a1bf62-5527-462d-aafb-8c1bee72ec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f816305e-c3a0-4d0f-b167-2508d955132f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f816305e-c3a0-4d0f-b167-2508d955132f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-328925300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0253c4-1e08-45b8-b18e-f7f4bd63e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86fe8f93a0c54754ba153261cbca816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:01Z,use_quota=True,user_id='c339c58acc044eda89a1ef59444f0fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdc1b8a-7e4d-4bd5-87af-6b05a9af5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdc1b8a-7e4d-4bd5-87af-6b05a9af5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35660e-4417-4b60-b2cc-07f45cb1e57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e35660e-4417-4b60-b2cc-07f45cb1e57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec0253c4-1e08-45b8-b18e-f7f4bd63e474', 'volume_name': 'volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb5b3d4-30b9-4bd3-8411-18b37ce40fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb5b3d4-30b9-4bd3-8411-18b37ce40fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3c421b-2ee1-415e-8e8b-b645cc595727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume ec0253c4-1e08-45b8-b18e-f7f4bd63e474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474', 'volume_size': 1} Aug 11 06:34:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:01 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:01 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info is being set with open permissions: ugo+rw Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:01 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info Aug 11 06:34:01 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Flow 'volume_create_manager' (35d59d54-f612-4c23-b70d-091d9315eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d11d6f4-710b-4be6-b393-3f6b0d1db853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d11d6f4-710b-4be6-b393-3f6b0d1db853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259996795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83a3299-b007-41b5-a833-d18d1c0a15bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86fe8f93a0c54754ba153261cbca816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:01Z,use_quota=True,user_id='c339c58acc044eda89a1ef59444f0fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515e486a-ab3c-49b4-97c1-f9d358292b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515e486a-ab3c-49b4-97c1-f9d358292b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d088394-74b4-45fb-8e4f-13d73fba7842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d088394-74b4-45fb-8e4f-13d73fba7842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd83a3299-b007-41b5-a833-d18d1c0a15bf', 'volume_name': 'volume-d83a3299-b007-41b5-a833-d18d1c0a15bf', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac776e3-d933-4885-9a97-fdf934d2918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac776e3-d933-4885-9a97-fdf934d2918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3331ec7c-4bb8-47f6-a67e-7513dc2099a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume d83a3299-b007-41b5-a833-d18d1c0a15bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d83a3299-b007-41b5-a833-d18d1c0a15bf', 'volume_size': 1} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:01 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.info" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.840s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.480s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:33:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1296102343',display_name='tempest-VolumesGetTest-Volume-1086352601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb186fc-d335-4cad-830d-07ea31e31a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:33:59Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Creating volume bdb186fc-d335-4cad-830d-07ea31e31a49 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:01 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:01 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 1073741824 Aug 11 06:34:01 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9232c06c-6390-44fa-a459-0a30b8cc9edc tempest-SnapshotsActionsTest-1210228608 None] Create snapshot completed successfully Aug 11 06:34:02 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 1073741824" returned: 0 in 0.550s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:02 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 Aug 11 06:34:02 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:02 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-328925300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec0253c4-1e08-45b8-b18e-f7f4bd63e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86fe8f93a0c54754ba153261cbca816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:01Z,use_quota=True,user_id='c339c58acc044eda89a1ef59444f0fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Creating volume ec0253c4-1e08-45b8-b18e-f7f4bd63e474 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:02 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f267732-5265-4661-968e-8dbfaab211be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb186fc-d335-4cad-830d-07ea31e31a49', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf18651-9f47-49c5-9a5a-f7f9f140cb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:02 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 1073741824 Aug 11 06:34:02 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:02 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Volume volume-bdb186fc-d335-4cad-830d-07ea31e31a49 (bdb186fc-d335-4cad-830d-07ea31e31a49): created successfully Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf18651-9f47-49c5-9a5a-f7f9f140cb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (16ee0114-f6da-498e-b9fd-ac43a34f2089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:02 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-83ffc561-a5b6-4902-b141-94d888df91a1 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:34:02 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 1073741824" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:03 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 Aug 11 06:34:03 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:03 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-259996795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d83a3299-b007-41b5-a833-d18d1c0a15bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86fe8f93a0c54754ba153261cbca816a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:01Z,use_quota=True,user_id='c339c58acc044eda89a1ef59444f0fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Creating volume d83a3299-b007-41b5-a833-d18d1c0a15bf {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3c421b-2ee1-415e-8e8b-b645cc595727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:03 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf 1073741824 Aug 11 06:34:03 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6932f-6547-4eb5-8e03-a5fd3758f2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-bdb186fc-d335-4cad-830d-07ea31e31a49-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 (ec0253c4-1e08-45b8-b18e-f7f4bd63e474): created successfully Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6932f-6547-4eb5-8e03-a5fd3758f2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Flow 'volume_create_manager' (02a1bf62-5527-462d-aafb-8c1bee72ec94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "cinder-bdb186fc-d335-4cad-830d-07ea31e31a49-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1abf7a02-0ec6-4e0b-82d0-fa1af4ffaa62 tempest-TestServerVolumeAttachmentScenario-998184964 None] Created volume successfully. Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-bdb186fc-d335-4cad-830d-07ea31e31a49" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-bdb186fc-d335-4cad-830d-07ea31e31a49" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[867a1112-3ab7-48e3-9c5f-9ad9ab35045a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:03 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 Aug 11 06:34:03 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:04 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf 1073741824" returned: 0 in 0.665s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:04 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf Aug 11 06:34:04 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:04 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49" returned: 0 in 0.512s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:04 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49 Aug 11 06:34:04 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:04 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf" returned: 0 in 0.350s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.877s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3331ec7c-4bb8-47f6-a67e-7513dc2099a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d83a3299-b007-41b5-a833-d18d1c0a15bf', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5dae1d-5081-4606-a570-e8bd8fef349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Creating offline snapshot c98d0ff5-2a59-40a5-9405-465690085684 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:34:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Volume volume-d83a3299-b007-41b5-a833-d18d1c0a15bf (d83a3299-b007-41b5-a833-d18d1c0a15bf): created successfully Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5dae1d-5081-4606-a570-e8bd8fef349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Flow 'volume_create_manager' (35d59d54-f612-4c23-b70d-091d9315eff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:04 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dc4d7f-5623-4d0c-883a-a2d30b34c7e4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bdb186fc-d335-4cad-830d-07ea31e31a49" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-967dbdeb-4007-4f7d-924d-43f1a212f495 tempest-TestServerVolumeAttachmentScenario-998184964 None] Created volume successfully. Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-bdb186fc-d335-4cad-830d-07ea31e31a49" released by "delete_volume" :: held 0.944s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Created reservations ['7509c40e-b25b-4e37-9218-9007fb485b03', '9b245832-c7ee-4dee-aa9c-74aa904bb887', '2be0dee3-bf67-4fd2-815d-f292ea318984', '3b2b61b0-9767-4cdf-926e-bbad4e541288'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:04 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:04 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:04 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:04 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:05 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:05 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 1G Aug 11 06:34:05 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:05 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.317s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-11c807f3-922f-4a6c-9dfd-a5fbb8cd09a9 tempest-VolumesGetTest-382793262 None] Lock "cinder-bdb186fc-d335-4cad-830d-07ea31e31a49-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:05 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 1G" returned: 0 in 0.598s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:05 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 Aug 11 06:34:05 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-b9c8a8db-28c0-41b8-bfdc-282e824d912b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "cinder-b9c8a8db-28c0-41b8-bfdc-282e824d912b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7403f-b032-4c28-8e99-abd4e2cca7ed]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:06 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 is being set with open permissions: ugo+rw Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:06 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b Aug 11 06:34:06 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:06 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 Aug 11 06:34:06 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:06 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:06 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b" returned: 0 in 0.451s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:06 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b Aug 11 06:34:06 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-48ef21c1-82d8-46f4-b25b-45bf753e0de3 tempest-SnapshotsActionsTest-1210228608 None] Create snapshot completed successfully Aug 11 06:34:06 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b9c8a8db-28c0-41b8-bfdc-282e824d912b" returned: 0 in 0.362s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-b9c8a8db-28c0-41b8-bfdc-282e824d912b" released by "delete_volume" :: held 0.886s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-c98d0ff5-2a59-40a5-9405-465690085684-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-c98d0ff5-2a59-40a5-9405-465690085684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-c98d0ff5-2a59-40a5-9405-465690085684" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Created reservations ['62ed6a1b-b0d8-4b8d-8888-4b8850649740', '498354c9-5269-4725-aae4-6125d29d791d', '7c93ce15-d828-4bc2-bb7d-51ee73b6b5c8', '05f0f69b-d3b4-4818-9d37-2313849d3f3d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-c98d0ff5-2a59-40a5-9405-465690085684" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Deleting offline snapshot c98d0ff5-2a59-40a5-9405-465690085684 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] snapshot_file for this snap is: volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[077952f9-ce72-4c18-997b-4a5cf1799ad5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:07 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 Aug 11 06:34:07 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:07 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:07 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:07 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684" returned: 0 in 0.587s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:07 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cfbd43-025d-42be-a2df-1c760898685a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-146c481d-3407-4016-af1d-4023a06c6a9a tempest-VolumesGetTest-382793262 None] Lock "cinder-b9c8a8db-28c0-41b8-bfdc-282e824d912b-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:07 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:07 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:08 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:08 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 Aug 11 06:34:08 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-6ec29e49-93cc-4c02-af59-fd9e79b70f4a-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "cinder-6ec29e49-93cc-4c02-af59-fd9e79b70f4a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e60e43-c0ac-468a-a98d-d3b65adf0452]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:08 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:34:08 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:08 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684" returned: 0 in 0.640s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:08 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684 Aug 11 06:34:08 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:09 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.472s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:09 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a Aug 11 06:34:09 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:09 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.c98d0ff5-2a59-40a5-9405-465690085684" returned: 0 in 0.352s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-c98d0ff5-2a59-40a5-9405-465690085684" released by "_delete_snapshot" :: held 2.268s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_snapshot" :: held 2.325s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:09 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-6ec29e49-93cc-4c02-af59-fd9e79b70f4a" released by "delete_volume" :: held 0.908s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Created reservations ['ea3ab89e-bf58-4c7b-bdb6-30fee6fede78', 'd0265d38-86f8-48d6-bfb8-48c402c4d723', 'caa66835-0db5-47f4-924d-3dc92b97a9c7', '92bcf0e6-4019-46d0-94bb-2918a00894ee'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Created reservations ['f2e29d22-776e-40f2-970d-5196f93aa42b', '787dd320-6676-4cfa-a65a-2d17fab149b9', 'f8ed1aa8-91eb-455b-9a31-43a38eedb937', '5a86b51e-eac0-4c28-8ad0-59bc18e38475'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Delete snapshot completed successfully. Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b1db554-beb0-4254-abe3-60c9ddc4512f tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-c98d0ff5-2a59-40a5-9405-465690085684-delete_snapshot" released by "delete_snapshot" :: held 2.616s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:09 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:09 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:09 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:09 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0e024c88-3d33-439b-b80a-c44110139582 tempest-VolumesGetTest-382793262 None] Lock "cinder-6ec29e49-93cc-4c02-af59-fd9e79b70f4a-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Creating offline snapshot 33ecec56-25e3-46f3-99e2-e4ed14da0a8a of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd6642b-5e2a-4cb3-8036-1d44ba2761c6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:10 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:10 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:11 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.874s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:11 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a 1G Aug 11 06:34:11 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (bf9ebfec-1931-4178-93a7-07b67471c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc4f600-801f-4af0-9571-6e565b3cfcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc4f600-801f-4af0-9571-6e565b3cfcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578657680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:12Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869dc11-576d-48c7-9aaa-b12ed7e759df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3869dc11-576d-48c7-9aaa-b12ed7e759df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2d7b5d-0d3b-4216-afc7-c6c0cf8d9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:34:12 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a 1G" returned: 0 in 0.792s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:12 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a Aug 11 06:34:12 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2d7b5d-0d3b-4216-afc7-c6c0cf8d9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9', 'volume_name': 'volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e256cade-46f5-4c08-9bdf-ac5e4c0b827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:12 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e256cade-46f5-4c08-9bdf-ac5e4c0b827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954ad3c8-a3f7-4707-8a35-5be3c2a6bdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Trying to clone 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a" returned: 0 in 0.531s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:12 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a is being set with open permissions: ugo+rw Aug 11 06:34:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:12 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a Aug 11 06:34:12 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:13 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a" returned: 0 in 0.448s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-73825858-296c-44c5-896e-ebd13099f34b tempest-SnapshotsActionsTest-1210228608 None] Create snapshot completed successfully Aug 11 06:34:13 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:34:13 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Image download 20.69 MB at 20.69 MB/s Aug 11 06:34:13 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a2f87-d796-43e0-ae5f-241f32319096]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:13 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD Aug 11 06:34:13 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:14 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 is fetched for user 3ff2f86e746f4953964a2d682307df35. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-33ecec56-25e3-46f3-99e2-e4ed14da0a8a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9590c88-ed35-45d8-9fc4-851dc342ee2e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-33ecec56-25e3-46f3-99e2-e4ed14da0a8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-33ecec56-25e3-46f3-99e2-e4ed14da0a8a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-33ecec56-25e3-46f3-99e2-e4ed14da0a8a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Deleting offline snapshot 33ecec56-25e3-46f3-99e2-e4ed14da0a8a of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] snapshot_file for this snap is: volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:34:14 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD Aug 11 06:34:14 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a53f16-36d8-438d-8e53-7f0aa342218f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:14 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a Aug 11 06:34:14 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:14 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-578657680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:12Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Creating volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:14 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:14 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1073741824 Aug 11 06:34:14 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:14 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a" returned: 0 in 0.523s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[803d759a-af16-4aec-a3c8-457ae51339da]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:15 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:15 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:15 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:15 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:15 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.480s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:15 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a Aug 11 06:34:15 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:15 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.459s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:34:15 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1073741824" returned: 0 in 0.744s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=179,cinder:SELECT=149,cinder:INSERT=41,cinder:DELETE=12 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=141,cinder:UPDATE=181,cinder:INSERT=44,cinder:DELETE=16 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:34:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:15 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 Aug 11 06:34:15 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:16 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Attempting download of b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:34:16 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a" returned: 0 in 0.649s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:16 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a Aug 11 06:34:16 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9894630d-cfca-4836-ab30-9fb2814c6522]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:16 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi Aug 11 06:34:16 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:16 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.33ecec56-25e3-46f3-99e2-e4ed14da0a8a" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-33ecec56-25e3-46f3-99e2-e4ed14da0a8a" released by "_delete_snapshot" :: held 2.307s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_snapshot" :: held 2.347s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Created reservations ['08f0a4b4-6d9b-4c75-b3ca-6f20ec8e3c2a', '17dbd405-6547-47a5-a3a7-072dd9fe6bc1', '9a1b7a45-f354-4b33-b99b-76a4af2d883a', 'b57846aa-935f-4d40-a76e-5dd6f363611e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Delete snapshot completed successfully. Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c97292dc-7acf-47bb-9833-6e564b53e504 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-33ecec56-25e3-46f3-99e2-e4ed14da0a8a-delete_snapshot" released by "delete_snapshot" :: held 2.628s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:16 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi" returned: 0 in 0.710s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:17 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi Aug 11 06:34:17 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:17 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi" returned: 1 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kwp7bzfi' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d7767-2d09-4082-a2f4-499315d09236]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:17 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD Aug 11 06:34:17 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:17 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] b9bfbb5e-34f5-42dc-847f-82185f2020b1 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:34:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:17 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 Aug 11 06:34:17 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Creating offline snapshot 45e03ee5-6a6a-46f4-91cd-a4ecde171451 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c4803-319a-4334-b7bf-d16560aba5c3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:18 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:18 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:18 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.549s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:18 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 1G Aug 11 06:34:18 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:19 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 1G" returned: 0 in 0.774s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:19 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 Aug 11 06:34:19 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:20 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451" returned: 0 in 0.666s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:20 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 is being set with open permissions: ugo+rw Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:20 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 Aug 11 06:34:20 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:20 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:20 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4b143e9b-26cd-4885-a8af-4c26ab4e7d28 tempest-SnapshotsActionsTest-1210228608 None] Create snapshot completed successfully Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" returned: 0 in 2.721s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_l6nq92hodevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:34:20 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Converted 112.00 MB image at 41.08 MB/s Aug 11 06:34:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:20 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1G Aug 11 06:34:20 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:21 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 1G" returned: 0 in 0.384s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Downloaded image b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 for user 3ff2f86e746f4953964a2d682307df35 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Marking volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Copying metadata from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 to 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Creating volume glance metadata for volume 5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 backed by image b9bfbb5e-34f5-42dc-847f-82185f2020b1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954ad3c8-a3f7-4707-8a35-5be3c2a6bdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6abda70-17ce-40e7-83e3-d623d728b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:21 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Volume volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 (5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9): created successfully Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6abda70-17ce-40e7-83e3-d623d728b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (bf9ebfec-1931-4178-93a7-07b67471c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-77e0a1d5-cf03-4a0a-9766-4d4ba185ca7e tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-45e03ee5-6a6a-46f4-91cd-a4ecde171451-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-45e03ee5-6a6a-46f4-91cd-a4ecde171451-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-45e03ee5-6a6a-46f4-91cd-a4ecde171451" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-45e03ee5-6a6a-46f4-91cd-a4ecde171451" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Deleting offline snapshot 45e03ee5-6a6a-46f4-91cd-a4ecde171451 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] snapshot_file for this snap is: volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23b766-21ff-40f0-9e7a-9aaed207c4b9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:21 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 Aug 11 06:34:21 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:22 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451" returned: 0 in 0.449s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1625434f-be26-4699-802d-36b0828d175d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:22 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:22 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:22 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.562s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:22 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 Aug 11 06:34:22 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (f079433d-45ca-4a7b-bf2d-cb4f99c44b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92b29d-4d78-474d-94aa-8c3aae6ab931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa92b29d-4d78-474d-94aa-8c3aae6ab931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1168283509',display_name='tempest-VolumesGetTest-Volume-62049838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded28360-1724-42ec-9198-f00ec01dd876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:23Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510716b7-3ed8-4c06-aa96-b8faa9f0ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510716b7-3ed8-4c06-aa96-b8faa9f0ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426fafd7-be2d-4dc0-9438-78fc38dd7249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426fafd7-be2d-4dc0-9438-78fc38dd7249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded28360-1724-42ec-9198-f00ec01dd876', 'volume_name': 'volume-ded28360-1724-42ec-9198-f00ec01dd876', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ee730-74f4-4bc8-b3ba-55e59ab1b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91ee730-74f4-4bc8-b3ba-55e59ab1b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff8c370-1ba0-412f-907b-a782a86fb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Volume ded28360-1724-42ec-9198-f00ec01dd876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded28360-1724-42ec-9198-f00ec01dd876', 'volume_size': 1} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1168283509',display_name='tempest-VolumesGetTest-Volume-62049838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded28360-1724-42ec-9198-f00ec01dd876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b04a0e624408a43bbda1ba300355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:23Z,use_quota=True,user_id='3ff2f86e746f4953964a2d682307df35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Creating volume ded28360-1724-42ec-9198-f00ec01dd876 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:23 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:23 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 1073741824 Aug 11 06:34:23 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:23 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451" returned: 0 in 0.711s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:23 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451 Aug 11 06:34:23 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:23 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.45e03ee5-6a6a-46f4-91cd-a4ecde171451" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-45e03ee5-6a6a-46f4-91cd-a4ecde171451" released by "_delete_snapshot" :: held 2.274s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_snapshot" :: held 2.307s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Created reservations ['c1d90c11-9330-47d4-97ea-5b652c62c6e7', '28501cbf-f3c9-4f3d-aeba-4c457dcb3b5b', 'ce7b8ed1-8bec-4f18-928c-921408632ffa', '97ed58e7-9050-4bc3-8c49-dcbb01bee619'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:23 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 1073741824" returned: 0 in 0.685s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Delete snapshot completed successfully. Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6245a48d-68e3-416a-88d6-fb81c4d7c941 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-45e03ee5-6a6a-46f4-91cd-a4ecde171451-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:24 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 Aug 11 06:34:24 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:24 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff8c370-1ba0-412f-907b-a782a86fb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded28360-1724-42ec-9198-f00ec01dd876', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649fcc62-1ec6-482f-b028-d38a236342c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Volume volume-ded28360-1724-42ec-9198-f00ec01dd876 (ded28360-1724-42ec-9198-f00ec01dd876): created successfully Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (649fcc62-1ec6-482f-b028-d38a236342c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Flow 'volume_create_manager' (f079433d-45ca-4a7b-bf2d-cb4f99c44b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:24 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e599aa16-efae-438b-a329-c32e937ca179 tempest-VolumesGetTest-382793262 None] Created volume successfully. Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Creating offline snapshot 19b90c58-2819-4fb1-a66b-3c015fcc62d8 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c9834-24ba-4eaf-98c2-a3e9f922f081]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:25 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:25 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-ded28360-1724-42ec-9198-f00ec01dd876-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "cinder-ded28360-1724-42ec-9198-f00ec01dd876-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-ded28360-1724-42ec-9198-f00ec01dd876" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-ded28360-1724-42ec-9198-f00ec01dd876" acquired by "delete_volume" :: waited 0.054s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[12966233-52f7-4e78-8e92-b633a204ba64]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:25 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.609s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:25 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 Aug 11 06:34:25 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:25 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 1G Aug 11 06:34:25 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:26 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876" returned: 0 in 0.500s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:26 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876 Aug 11 06:34:26 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 1G" returned: 0 in 0.716s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:26 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ded28360-1724-42ec-9198-f00ec01dd876" returned: 0 in 0.366s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:26 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 Aug 11 06:34:26 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-ded28360-1724-42ec-9198-f00ec01dd876" released by "delete_volume" :: held 0.948s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Created reservations ['6d824297-85bb-47c3-b151-0b134f38765c', '76589d0b-d945-4d2f-945a-8ea1e8c975b3', '2d1aa30f-939a-4e58-944d-5a675f603d71', '7785ed43-3b33-46ba-a9cf-db9ed924a7cd'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:26 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:26 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:26 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8" returned: 0 in 0.383s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:26 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 is being set with open permissions: ugo+rw Aug 11 06:34:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:26 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 Aug 11 06:34:26 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:27 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.272s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4ba71324-3647-4004-aee2-22671a976716 tempest-VolumesGetTest-382793262 None] Lock "cinder-ded28360-1724-42ec-9198-f00ec01dd876-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:27 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-803f7cdf-0781-47b2-8c06-e39e9fb4a9e3 tempest-SnapshotsActionsTest-1210228608 None] Create snapshot completed successfully Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "cinder-quobyte-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a27afbd-9695-4008-b14c-0cd5632bedf3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:28 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 Aug 11 06:34:28 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-19b90c58-2819-4fb1-a66b-3c015fcc62d8-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-19b90c58-2819-4fb1-a66b-3c015fcc62d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Acquiring lock "cinder-quobyte-19b90c58-2819-4fb1-a66b-3c015fcc62d8" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-19b90c58-2819-4fb1-a66b-3c015fcc62d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:28 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Deleting offline snapshot 19b90c58-2819-4fb1-a66b-3c015fcc62d8 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] snapshot_file for this snap is: volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" returned: 0 in 0.432s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd70a1-8648-40a7-b1c5-58d7ae9d5778]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:28 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9 Aug 11 06:34:28 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:28 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 Aug 11 06:34:28 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:28 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" returned: 0 in 0.292s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-quobyte-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9" released by "delete_volume" :: held 0.771s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Created reservations ['f239c30d-6041-46ea-bf64-82af9bb78bbd', '9a58cf16-0756-489e-835d-4bac16078633', '4a6ff021-5fe6-444f-94b4-b4e7604ae61d', 'f53c31dd-c679-49b7-8fa4-6ff65e3bbd4f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:28 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8" returned: 0 in 0.396s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd6c9c4-4aad-44b6-b58f-6f0d8fbf9565]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:28 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:28 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:29 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:29 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:29 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.340s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Deleted volume successfully. Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b1770f68-f942-4b13-8010-65d6616579c3 tempest-VolumesGetTest-382793262 None] Lock "cinder-5050722f-04e8-4f6b-a7d3-cf6cb8f3f2b9-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:29 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.452s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:29 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 Aug 11 06:34:29 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:29 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:29 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8 Aug 11 06:34:29 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:30 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.19b90c58-2819-4fb1-a66b-3c015fcc62d8" returned: 0 in 0.265s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-19b90c58-2819-4fb1-a66b-3c015fcc62d8" released by "_delete_snapshot" :: held 1.708s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_snapshot" :: held 1.732s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Created reservations ['34ad2d43-592e-4670-8214-86d414076762', 'c0569c4d-7344-4037-acf5-c6c8f33be562', '9305c244-05d2-401e-ab5b-18766269edec', '831012b5-8ae7-4d66-be3a-7e3058b4d283'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Delete snapshot completed successfully. Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-824cf67d-a608-459a-b418-a73922471296 tempest-SnapshotsActionsTest-717911662 None] Lock "cinder-19b90c58-2819-4fb1-a66b-3c015fcc62d8-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "cinder-832e9a65-6337-4855-84f1-f87ae3a80306-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-832e9a65-6337-4855-84f1-f87ae3a80306-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "cinder-quobyte-832e9a65-6337-4855-84f1-f87ae3a80306" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-832e9a65-6337-4855-84f1-f87ae3a80306" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Deleting offline snapshot 832e9a65-6337-4855-84f1-f87ae3a80306 of volume bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] snapshot_file for this snap is: volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b67ec-0d2f-41e5-b60e-253f8ca60e75]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:31 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:31 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:31 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da7e85-00c2-47e1-9672-a8ec249d54b5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:31 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d Aug 11 06:34:31 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:31 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:31 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:31 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:32 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:32 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306 Aug 11 06:34:32 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:32 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d.832e9a65-6337-4855-84f1-f87ae3a80306" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-832e9a65-6337-4855-84f1-f87ae3a80306" released by "_delete_snapshot" :: held 1.803s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_snapshot" :: held 1.833s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:32 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Created reservations ['52b4f1a4-4523-4cd8-ac82-af1e4c07d3f1', '2a4a3764-c2da-4cf0-99f6-ddc7e6fff1db', '648410e8-14be-4e1c-a0e8-44cc50120ed9', 'abdffb8d-448f-492e-b42b-ab497686835b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Delete snapshot completed successfully. Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c0acc53a-a06e-4550-861a-7c9909be74c1 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-832e9a65-6337-4855-84f1-f87ae3a80306-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "cinder-bade0a6d-de9f-4481-b9b1-e8e79952f98d-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-bade0a6d-de9f-4481-b9b1-e8e79952f98d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f46b1-f0a4-4f42-88b0-e93c82e10d46]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:33 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d Aug 11 06:34:33 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:34 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d" returned: 0 in 0.605s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:34 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d Aug 11 06:34:34 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:34 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-bade0a6d-de9f-4481-b9b1-e8e79952f98d" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-quobyte-bade0a6d-de9f-4481-b9b1-e8e79952f98d" released by "delete_volume" :: held 1.094s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Created reservations ['7a2b3815-f508-4255-af72-18d1eda89f23', 'a148ee1b-922e-44e4-be7a-3900c2da68dc', '0a0086cb-e8be-4510-96a6-6fe61b5bf07c', '9af52224-8d82-4d70-b47d-32d0913018e7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:34 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:34 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:35 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:35 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Deleted volume successfully. Aug 11 06:34:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e2fe1bbd-e8b2-4751-8a57-cb38a832e260 tempest-SnapshotsActionsTest-1210228608 None] Lock "cinder-bade0a6d-de9f-4481-b9b1-e8e79952f98d-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:34:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-402f9ca8-0747-474a-8c3b-4347006e994d req-16bdf65a-be2f-4bdf-b592-e5d01d42c95d tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-402f9ca8-0747-474a-8c3b-4347006e994d req-16bdf65a-be2f-4bdf-b592-e5d01d42c95d tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-402f9ca8-0747-474a-8c3b-4347006e994d req-16bdf65a-be2f-4bdf-b592-e5d01d42c95d tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-402f9ca8-0747-474a-8c3b-4347006e994d req-16bdf65a-be2f-4bdf-b592-e5d01d42c95d tempest-TestServerVolumeAttachmentScenario-998184964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2d474bf-0f72-4229-8bdd-ec5c679b2e34', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:34:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-402f9ca8-0747-474a-8c3b-4347006e994d req-16bdf65a-be2f-4bdf-b592-e5d01d42c95d tempest-TestServerVolumeAttachmentScenario-998184964 None] attachment_update completed successfully. Aug 11 06:34:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-52c8d2c8-83eb-464b-90dd-51bf6c2fea16 req-2a929ba2-b123-425b-9297-f5d9577429ab tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-52c8d2c8-83eb-464b-90dd-51bf6c2fea16 req-2a929ba2-b123-425b-9297-f5d9577429ab tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-52c8d2c8-83eb-464b-90dd-51bf6c2fea16 req-2a929ba2-b123-425b-9297-f5d9577429ab tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-52c8d2c8-83eb-464b-90dd-51bf6c2fea16 req-2a929ba2-b123-425b-9297-f5d9577429ab tempest-TestServerVolumeAttachmentScenario-998184964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-d83a3299-b007-41b5-a833-d18d1c0a15bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d3e4cdf-e1c6-4c0c-a8b6-f3f859286ab3', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:34:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-52c8d2c8-83eb-464b-90dd-51bf6c2fea16 req-2a929ba2-b123-425b-9297-f5d9577429ab tempest-TestServerVolumeAttachmentScenario-998184964 None] attachment_update completed successfully. Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Flow 'volume_create_manager' (527048e4-f39f-410c-8d09-5dbe1a7d0fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b9701-432c-4f17-99a3-7b1cc321c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5b9701-432c-4f17-99a3-7b1cc321c275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2005334905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803680fa-4123-41e8-8ce4-ba5f56f8127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cef649d4c24449b3b90151da427dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:56Z,use_quota=True,user_id='43290fa3efc24eee97dcc1e8a5186258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de126282-a974-4e59-8168-0ae0b1bdae76),volume_type_id=de126282-a974-4e59-8168-0ae0b1bdae76)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d339be-a2cb-4997-9870-51cf79e95192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d339be-a2cb-4997-9870-51cf79e95192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88689b9b-a2e3-498b-bfb0-dd2fd8d0aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88689b9b-a2e3-498b-bfb0-dd2fd8d0aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803680fa-4123-41e8-8ce4-ba5f56f8127b', 'volume_name': 'volume-803680fa-4123-41e8-8ce4-ba5f56f8127b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645190cd-8698-462c-bf7f-f301890c4193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645190cd-8698-462c-bf7f-f301890c4193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e2db19-9627-4a06-80c5-d4b6cdc8a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Volume 803680fa-4123-41e8-8ce4-ba5f56f8127b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803680fa-4123-41e8-8ce4-ba5f56f8127b', 'volume_size': 1} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2005334905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803680fa-4123-41e8-8ce4-ba5f56f8127b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58cef649d4c24449b3b90151da427dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:34:56Z,use_quota=True,user_id='43290fa3efc24eee97dcc1e8a5186258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de126282-a974-4e59-8168-0ae0b1bdae76),volume_type_id=de126282-a974-4e59-8168-0ae0b1bdae76)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Creating volume 803680fa-4123-41e8-8ce4-ba5f56f8127b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:34:55 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:55 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b 1073741824 Aug 11 06:34:55 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-ed6e0a19-1abd-4a44-aefd-3ea8d108a963 req-684aceb3-2e57-4e4e-91e5-a445bde9188e tempest-TestServerVolumeAttachmentScenario-998184964 None] Terminate volume connection completed successfully. Aug 11 06:34:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-ed6e0a19-1abd-4a44-aefd-3ea8d108a963 req-684aceb3-2e57-4e4e-91e5-a445bde9188e tempest-TestServerVolumeAttachmentScenario-998184964 None] Deleting attachment 8d3e4cdf-e1c6-4c0c-a8b6-f3f859286ab3. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:34:56 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b 1073741824" returned: 0 in 0.474s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:56 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b Aug 11 06:34:56 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:56 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e2db19-9627-4a06-80c5-d4b6cdc8a853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803680fa-4123-41e8-8ce4-ba5f56f8127b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e473fb9-77a3-4ffb-b0ad-11dfa2f9c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:34:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Volume volume-803680fa-4123-41e8-8ce4-ba5f56f8127b (803680fa-4123-41e8-8ce4-ba5f56f8127b): created successfully Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e473fb9-77a3-4ffb-b0ad-11dfa2f9c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:34:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Flow 'volume_create_manager' (527048e4-f39f-410c-8d09-5dbe1a7d0fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:34:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-16b6b6c5-3fe8-4e3c-8f61-31b7c4de235a tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Created volume successfully. Aug 11 06:34:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-5faeacbc-ce4c-4343-b354-a0179bc3b8af req-63ea8876-c09e-480c-b5ae-117297de6d10 tempest-TestServerVolumeAttachmentScenario-998184964 None] Terminate volume connection completed successfully. Aug 11 06:34:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-5faeacbc-ce4c-4343-b354-a0179bc3b8af req-63ea8876-c09e-480c-b5ae-117297de6d10 tempest-TestServerVolumeAttachmentScenario-998184964 None] Deleting attachment d2d474bf-0f72-4229-8bdd-ec5c679b2e34. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:58 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:34:58 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:34:58 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:34:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:34:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0564018a-e9fe-4dab-96eb-8bef624cf1fe tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Retype volume completed successfully. Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "cinder-803680fa-4123-41e8-8ce4-ba5f56f8127b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "cinder-803680fa-4123-41e8-8ce4-ba5f56f8127b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "cinder-quobyte-803680fa-4123-41e8-8ce4-ba5f56f8127b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "cinder-quobyte-803680fa-4123-41e8-8ce4-ba5f56f8127b" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c64685-48ee-4032-8c95-bd3ad4cb98d2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:34:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:34:59 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b Aug 11 06:34:59 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:00 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:00 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b Aug 11 06:35:00 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:00 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-803680fa-4123-41e8-8ce4-ba5f56f8127b" returned: 0 in 0.425s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "cinder-quobyte-803680fa-4123-41e8-8ce4-ba5f56f8127b" released by "delete_volume" :: held 0.943s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:00 devstack cinder-volume[94463]: WARNING cinder.quota [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:35:00 devstack cinder-volume[94463]: WARNING cinder.quota [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Created reservations ['a3b9035e-fdae-43b6-b5ac-77ac4950b5d1', '2a4ae839-9be3-4e04-b2e7-3593e0c85f87', 'a176a382-d260-42a2-922e-6213d71111d7', '34e3288a-e35e-41dd-b4f5-94ee221abfc1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:00 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:35:00 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:01 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.366s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:01 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:35:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Deleted volume successfully. Aug 11 06:35:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bdc1cfe8-bf3f-4567-89d0-0dff0a6b0a2d tempest-VolumeRetypeWithoutMigrationTest-1688690267 None] Lock "cinder-803680fa-4123-41e8-8ce4-ba5f56f8127b-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "cinder-d83a3299-b007-41b5-a833-d18d1c0a15bf-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-d83a3299-b007-41b5-a833-d18d1c0a15bf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "cinder-quobyte-d83a3299-b007-41b5-a833-d18d1c0a15bf" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-quobyte-d83a3299-b007-41b5-a833-d18d1c0a15bf" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea4eeb-f1a8-4746-998c-5c736440d07a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:35:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:03 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf Aug 11 06:35:03 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:03 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf" returned: 0 in 0.560s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:03 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf Aug 11 06:35:03 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:04 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d83a3299-b007-41b5-a833-d18d1c0a15bf" returned: 0 in 0.507s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-quobyte-d83a3299-b007-41b5-a833-d18d1c0a15bf" released by "delete_volume" :: held 1.148s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Created reservations ['b342d73e-58c0-4230-a0e7-50817b13ffdb', 'e7124a50-44e1-4509-b983-b1f1b8fe12e6', 'f4bbb035-c659-4ba2-bf21-89591deb1e57', '4203fac7-62e5-4889-b3b8-822fb68526d9'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:04 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:35:04 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:04 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:35:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Deleted volume successfully. Aug 11 06:35:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-df476a06-ac5b-4f74-a18d-74b8821c7fb4 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-d83a3299-b007-41b5-a833-d18d1c0a15bf-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "cinder-ec0253c4-1e08-45b8-b18e-f7f4bd63e474-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-ec0253c4-1e08-45b8-b18e-f7f4bd63e474-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "cinder-quobyte-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-quobyte-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" acquired by "delete_volume" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c408e17-e6f7-4544-8f77-8e25544dc6e1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:05 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 Aug 11 06:35:05 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:05 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" returned: 0 in 0.596s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:05 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474 Aug 11 06:35:05 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:06 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" returned: 0 in 0.371s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-quobyte-ec0253c4-1e08-45b8-b18e-f7f4bd63e474" released by "delete_volume" :: held 1.038s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Created reservations ['816f6bab-d3df-47c2-bf93-abbf03de0f53', '00441139-3e72-4659-9869-dec2fc241a0d', 'ebb9b32d-c082-4889-abb0-14d042d08e10', '49e40ca6-856d-4c70-9449-d7e410218f5e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:06 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:35:06 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:06 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.420s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:06 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:35:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Deleted volume successfully. Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-dbbbf2a9-416d-4e47-9f00-12d437e893e7 tempest-TestServerVolumeAttachmentScenario-998184964 None] Lock "cinder-ec0253c4-1e08-45b8-b18e-f7f4bd63e474-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Flow 'volume_create_manager' (92412313-fe44-404f-aed2-0470726a86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9328b2-bf1f-4806-8b9e-095dde253f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9328b2-bf1f-4806-8b9e-095dde253f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1167330259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb6364c-cc80-4c96-af19-664961594c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5173258b834fef9252114fb37da30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:07Z,use_quota=True,user_id='75936bc863bf4261952ce45dbec9b847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75031ae2-6c38-403e-b082-b81eff6663da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75031ae2-6c38-403e-b082-b81eff6663da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbc1950-66bf-42bd-a571-3c6896919537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbc1950-66bf-42bd-a571-3c6896919537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb6364c-cc80-4c96-af19-664961594c5c', 'volume_name': 'volume-afb6364c-cc80-4c96-af19-664961594c5c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c63ae7-093e-44c6-bce6-4a88899ec2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c63ae7-093e-44c6-bce6-4a88899ec2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b0c8a-9d7f-4dd8-8ec0-f7ee600cc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:07 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Volume afb6364c-cc80-4c96-af19-664961594c5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb6364c-cc80-4c96-af19-664961594c5c', 'volume_size': 1} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1167330259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb6364c-cc80-4c96-af19-664961594c5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d5173258b834fef9252114fb37da30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:07Z,use_quota=True,user_id='75936bc863bf4261952ce45dbec9b847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Creating volume afb6364c-cc80-4c96-af19-664961594c5c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:35:07 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:07 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c 1073741824 Aug 11 06:35:07 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:07 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c 1073741824" returned: 0 in 0.580s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:07 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c Aug 11 06:35:07 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:08 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09b0c8a-9d7f-4dd8-8ec0-f7ee600cc670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb6364c-cc80-4c96-af19-664961594c5c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77b1450-7bd3-45e5-aecb-e01900f00bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Volume volume-afb6364c-cc80-4c96-af19-664961594c5c (afb6364c-cc80-4c96-af19-664961594c5c): created successfully Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77b1450-7bd3-45e5-aecb-e01900f00bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Flow 'volume_create_manager' (92412313-fe44-404f-aed2-0470726a86c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:08 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-73ce5ba6-9f5d-484a-b9ab-1e2ab0f94e13 tempest-AttachVolumeShelveTestJSON-1465146425 None] Created volume successfully. Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:15 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:35:15 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:15 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.457s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:35:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:35:18 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=94,cinder:INSERT=25,cinder:UPDATE=98,cinder:DELETE=5 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:35:18 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=84,cinder:INSERT=31,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:35:18 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:35:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Flow 'volume_create_manager' (0295950d-3991-46fb-b34c-613fa5590a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd489b49-2b72-4f03-8d7c-5c91eed6c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd489b49-2b72-4f03-8d7c-5c91eed6c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-441956367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecb9b6c-835f-46f1-a6bc-75536163c51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66691fc57d16496fa6a3ca9fb2ca0a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:19Z,use_quota=True,user_id='b8c474951b0d4d8e9f7dbb5f347d48f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad8447c5-fc40-4310-9336-2c3b95e3e290),volume_type_id=ad8447c5-fc40-4310-9336-2c3b95e3e290)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1682271c-c894-4fe2-afb2-70c37fd6874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1682271c-c894-4fe2-afb2-70c37fd6874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b9a93-6f6e-4d34-ac73-a6ac8ab597a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b9a93-6f6e-4d34-ac73-a6ac8ab597a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ecb9b6c-835f-46f1-a6bc-75536163c51f', 'volume_name': 'volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c3efb7-4050-42c3-986c-f1085340683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c3efb7-4050-42c3-986c-f1085340683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4785b291-c7b8-473a-b745-c68e059ab87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:19 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Volume 3ecb9b6c-835f-46f1-a6bc-75536163c51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f', 'volume_size': 1} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-441956367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecb9b6c-835f-46f1-a6bc-75536163c51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66691fc57d16496fa6a3ca9fb2ca0a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:19Z,use_quota=True,user_id='b8c474951b0d4d8e9f7dbb5f347d48f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad8447c5-fc40-4310-9336-2c3b95e3e290),volume_type_id=ad8447c5-fc40-4310-9336-2c3b95e3e290)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Creating volume 3ecb9b6c-835f-46f1-a6bc-75536163c51f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:35:19 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:19 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f 1073741824 Aug 11 06:35:19 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:19 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f 1073741824" returned: 0 in 0.893s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:20 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f Aug 11 06:35:20 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:20 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f" returned: 0 in 0.381s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4785b291-c7b8-473a-b745-c68e059ab87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d274d3ad-021b-4b4c-a9ae-f28eb82a8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:20 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Volume volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f (3ecb9b6c-835f-46f1-a6bc-75536163c51f): created successfully Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d274d3ad-021b-4b4c-a9ae-f28eb82a8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Flow 'volume_create_manager' (0295950d-3991-46fb-b34c-613fa5590a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-362ce6f1-f576-4823-85ac-e2babbd354eb tempest-VolumeTypesAccessTest-1056644119 None] Created volume successfully. Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Acquiring lock "cinder-3ecb9b6c-835f-46f1-a6bc-75536163c51f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "cinder-3ecb9b6c-835f-46f1-a6bc-75536163c51f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Acquiring lock "cinder-quobyte-3ecb9b6c-835f-46f1-a6bc-75536163c51f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "cinder-quobyte-3ecb9b6c-835f-46f1-a6bc-75536163c51f" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea76b0-c38f-4d44-bc08-06526b1ff244]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:35:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:21 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f Aug 11 06:35:21 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:22 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f" returned: 0 in 0.746s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:22 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f Aug 11 06:35:22 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:22 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ecb9b6c-835f-46f1-a6bc-75536163c51f" returned: 0 in 0.372s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "cinder-quobyte-3ecb9b6c-835f-46f1-a6bc-75536163c51f" released by "delete_volume" :: held 1.231s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:22 devstack cinder-volume[94463]: WARNING cinder.quota [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1843783659 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1843783659, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:35:22 devstack cinder-volume[94463]: WARNING cinder.quota [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1843783659 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1843783659, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Created reservations ['13ab8450-b66d-4639-8094-07b786aafa23', 'be164def-c736-441d-aa68-f1a2d2e5025e', '1176507b-55cc-4cfe-ac97-fa208ed7609d', '316bb204-77cf-4c59-93cb-6340f48fb06a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:23 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:35:23 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:23 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.357s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:23 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:35:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Deleted volume successfully. Aug 11 06:35:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca565587-5a7b-456f-9861-f18c7b2da9e9 tempest-VolumeTypesAccessTest-1056644119 None] Lock "cinder-3ecb9b6c-835f-46f1-a6bc-75536163c51f-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:35:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-f4e6faaa-aecd-4fcc-82ab-37e3a76c8125 req-f6135623-3b54-4e2a-bd58-0bc211313c16 tempest-AttachVolumeShelveTestJSON-1465146425 None] No connector for attachment 6ef3562d-617c-4b4e-b574-d5cf57b981cd; skipping storage backend terminate_connection call. {{(pid=94463) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 11 06:35:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-f4e6faaa-aecd-4fcc-82ab-37e3a76c8125 req-f6135623-3b54-4e2a-bd58-0bc211313c16 tempest-AttachVolumeShelveTestJSON-1465146425 None] Deleting attachment 6ef3562d-617c-4b4e-b574-d5cf57b981cd. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:35:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Flow 'volume_create_manager' (22cfe728-7053-45d3-8d1a-ea96dfa23142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd78ac9-85c3-4ae8-ba6b-d957e2602a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dd78ac9-85c3-4ae8-ba6b-d957e2602a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-437855081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7378cb917dc436a88eb08bad9550cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:27Z,use_quota=True,user_id='cde00ecec8b04c459f159cd238ae76d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa86890f-cba9-4eba-93d2-d3f7fcbff4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa86890f-cba9-4eba-93d2-d3f7fcbff4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae37818-e905-4f30-9961-b30307874dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae37818-e905-4f30-9961-b30307874dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2fe5a9b-078a-42f3-8aa6-dd32cf6449e7', 'volume_name': 'volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a4b613-27f9-4c11-8562-b34b9a241fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a4b613-27f9-4c11-8562-b34b9a241fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6699462-0d15-44d4-93b8-a73c04e6b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Volume d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7', 'volume_size': 1} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-437855081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7378cb917dc436a88eb08bad9550cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:35:27Z,use_quota=True,user_id='cde00ecec8b04c459f159cd238ae76d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Creating volume d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:35:27 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:35:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:27 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 1073741824 Aug 11 06:35:27 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:27 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 1073741824" returned: 0 in 0.832s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:35:28 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 Aug 11 06:35:28 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:35:28 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" returned: 0 in 0.495s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6699462-0d15-44d4-93b8-a73c04e6b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4131ab76-93b6-4392-8c95-eeae5cc6762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:35:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Volume volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 (d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7): created successfully Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4131ab76-93b6-4392-8c95-eeae5cc6762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:35:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Flow 'volume_create_manager' (22cfe728-7053-45d3-8d1a-ea96dfa23142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:35:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-117e13fd-351c-4d63-9353-4d79d266dcd2 tempest-TestMinimumBasicScenario-279465238 None] Created volume successfully. Aug 11 06:35:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-42e86c9e-4ef9-4426-91c5-6dac99ec4209 req-4563e7f5-d5c6-435a-a17c-6090f6b44d84 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:35:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-42e86c9e-4ef9-4426-91c5-6dac99ec4209 req-4563e7f5-d5c6-435a-a17c-6090f6b44d84 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:35:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-42e86c9e-4ef9-4426-91c5-6dac99ec4209 req-4563e7f5-d5c6-435a-a17c-6090f6b44d84 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:35:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-42e86c9e-4ef9-4426-91c5-6dac99ec4209 req-4563e7f5-d5c6-435a-a17c-6090f6b44d84 tempest-TestMinimumBasicScenario-279465238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71a79add-c10f-4c66-a6e1-acd6562767a3', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:35:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-42e86c9e-4ef9-4426-91c5-6dac99ec4209 req-4563e7f5-d5c6-435a-a17c-6090f6b44d84 tempest-TestMinimumBasicScenario-279465238 None] attachment_update completed successfully. Aug 11 06:35:40 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=3 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:35:40 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=18,cinder:INSERT=3,cinder:SELECT=16,cinder:DELETE=2 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:35:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:35:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Flow 'volume_create_manager' (6181ff38-1785-469c-9d87-58a2c4e7d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078f4f0-0ffd-4f73-b28f-1e602796c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f078f4f0-0ffd-4f73-b28f-1e602796c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-423112797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4323d8a7-9942-4e24-a16c-3f0160c9e831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241714eccff64b658efd195aa29b8a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:36:05Z,use_quota=True,user_id='b5eac4df414e4f839aa49ebc70e31fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8b5c24-6495-449c-b5d7-78c949a09aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8b5c24-6495-449c-b5d7-78c949a09aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bcaaf4-1cdd-4071-8518-5f4a12952084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bcaaf4-1cdd-4071-8518-5f4a12952084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4323d8a7-9942-4e24-a16c-3f0160c9e831', 'volume_name': 'volume-4323d8a7-9942-4e24-a16c-3f0160c9e831', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28e9438-47b0-46f3-9ae7-22171246fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28e9438-47b0-46f3-9ae7-22171246fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfd6ca5-34ef-4683-9b4b-facce212eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Volume 4323d8a7-9942-4e24-a16c-3f0160c9e831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4323d8a7-9942-4e24-a16c-3f0160c9e831', 'volume_size': 1} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-423112797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4323d8a7-9942-4e24-a16c-3f0160c9e831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='241714eccff64b658efd195aa29b8a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:36:05Z,use_quota=True,user_id='b5eac4df414e4f839aa49ebc70e31fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Creating volume 4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:36:05 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:05 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 1073741824 Aug 11 06:36:05 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:05 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 1073741824" returned: 0 in 0.641s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:05 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:05 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:06 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.326s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfd6ca5-34ef-4683-9b4b-facce212eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4323d8a7-9942-4e24-a16c-3f0160c9e831', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa5c27-0fc9-43ff-a14b-0a1dbd258687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Volume volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 (4323d8a7-9942-4e24-a16c-3f0160c9e831): created successfully Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa5c27-0fc9-43ff-a14b-0a1dbd258687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Flow 'volume_create_manager' (6181ff38-1785-469c-9d87-58a2c4e7d311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:36:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-86426590-9042-4bac-9c99-426b5981386f tempest-TestImageHashVerification-1943800700 None] Created volume successfully. Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3abc43b-a721-4352-b258-a40b14f2c8f7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:08 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:08 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:08 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.701s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2da196-830e-4d1e-a369-e993b6761435]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:09 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:09 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:09 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.588s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 /opt/stack/data/cinder/conversion/4323d8a7-9942-4e24-a16c-3f0160c9e831.temp_image.4b0d436c-eb97-45f1-891e-6011bbbea4dc7wwq041k.img {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:09 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 /opt/stack/data/cinder/conversion/4323d8a7-9942-4e24-a16c-3f0160c9e831.temp_image.4b0d436c-eb97-45f1-891e-6011bbbea4dc7wwq041k.img Aug 11 06:36:09 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Acquiring lock "cinder-afb6364c-cc80-4c96-af19-664961594c5c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "cinder-afb6364c-cc80-4c96-af19-664961594c5c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Acquiring lock "cinder-quobyte-afb6364c-cc80-4c96-af19-664961594c5c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "cinder-quobyte-afb6364c-cc80-4c96-af19-664961594c5c" acquired by "delete_volume" :: waited 0.077s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbbb3b7-59a4-4e8e-b2a0-f8cc1a923fc5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:14 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c Aug 11 06:36:14 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:15 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:36:15 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:15 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.668s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:36:15 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c" returned: 0 in 1.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:15 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c Aug 11 06:36:15 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:15 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 /opt/stack/data/cinder/conversion/4323d8a7-9942-4e24-a16c-3f0160c9e831.temp_image.4b0d436c-eb97-45f1-891e-6011bbbea4dc7wwq041k.img" returned: 0 in 6.342s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a46b4b-7974-4f22-9427-6cddcdd873fd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:16 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:16 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:16 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-afb6364c-cc80-4c96-af19-664961594c5c" returned: 0 in 0.422s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "cinder-quobyte-afb6364c-cc80-4c96-af19-664961594c5c" released by "delete_volume" :: held 1.872s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Created reservations ['fc0f5ad4-ade4-4cd8-9ad8-f046cadf9cc2', '752378c3-9ba7-476f-82f6-a43a26875ba0', 'f9c6fbe1-6bfd-4d7c-825c-266a82e7f252', '5a7eefd6-ebce-4603-afb9-7f33794d88b6'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:16 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:36:16 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:16 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.806s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/conversion/4323d8a7-9942-4e24-a16c-3f0160c9e831.temp_image.4b0d436c-eb97-45f1-891e-6011bbbea4dc7wwq041k.img {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:36:16 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Converted 1024.00 MB image at 161.44 MB/s Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] 4b0d436c-eb97-45f1-891e-6011bbbea4dc was raw, no need to convert to raw {{(pid=94463) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 11 06:36:16 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:36:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Deleted volume successfully. Aug 11 06:36:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e0e369d3-1d25-44bd-981a-55ab7dcd6f24 tempest-AttachVolumeShelveTestJSON-1465146425 None] Lock "cinder-afb6364c-cc80-4c96-af19-664961594c5c-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:26 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:36:26 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (711fe9c0-f7f3-491f-be34-519a5e74af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a961d5-10b1-43d6-a449-0c78d2d6c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a961d5-10b1-43d6-a449-0c78d2d6c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-416408629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34ca9de-732e-4711-b588-acb6450ae691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:36:31Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e25e47-2747-477a-97f5-596ee9cff575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e25e47-2747-477a-97f5-596ee9cff575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584fcf05-7865-4ce3-903a-b1049a6c2386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584fcf05-7865-4ce3-903a-b1049a6c2386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34ca9de-732e-4711-b588-acb6450ae691', 'volume_name': 'volume-d34ca9de-732e-4711-b588-acb6450ae691', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a15641-4045-495c-ad2b-1af33c8d2d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a15641-4045-495c-ad2b-1af33c8d2d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fd562a-4350-4e3b-b5ea-1dd682ed934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Volume d34ca9de-732e-4711-b588-acb6450ae691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34ca9de-732e-4711-b588-acb6450ae691', 'volume_size': 1} Aug 11 06:36:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:40 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:36:41 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=2 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:36:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-89d64ddd-c755-4e0a-8bbf-b14603f774cc req-c00c5169-f73f-4143-9b11-7d1966a9f457 tempest-TestMinimumBasicScenario-279465238 None] Terminate volume connection completed successfully. Aug 11 06:36:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-89d64ddd-c755-4e0a-8bbf-b14603f774cc req-c00c5169-f73f-4143-9b11-7d1966a9f457 tempest-TestMinimumBasicScenario-279465238 None] Deleting attachment 71a79add-c10f-4c66-a6e1-acd6562767a3. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.537s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Uploaded volume to glance image-id: 4b0d436c-eb97-45f1-891e-6011bbbea4dc. {{(pid=94463) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.611s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-416408629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34ca9de-732e-4711-b588-acb6450ae691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:36:31Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Creating volume d34ca9de-732e-4711-b588-acb6450ae691 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:36:50 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:36:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:50 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 1073741824 Aug 11 06:36:50 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f0d97e36-0d32-43e8-8214-8bedc0d69ab3 tempest-TestImageHashVerification-1943800700 None] Copy volume to image completed successfully. Aug 11 06:36:51 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 1073741824" returned: 0 in 0.628s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:51 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 Aug 11 06:36:51 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "cinder-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "cinder-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "cinder-quobyte-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "cinder-quobyte-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c2a46-cf55-4e5b-8205-3a80dc6b3b29]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:51 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 Aug 11 06:36:51 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:51 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fd562a-4350-4e3b-b5ea-1dd682ed934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34ca9de-732e-4711-b588-acb6450ae691', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3e0ab3-28a4-4d7f-847e-56386cec53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:36:51 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Volume volume-d34ca9de-732e-4711-b588-acb6450ae691 (d34ca9de-732e-4711-b588-acb6450ae691): created successfully Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3e0ab3-28a4-4d7f-847e-56386cec53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:36:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (711fe9c0-f7f3-491f-be34-519a5e74af24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:36:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0c2e90e5-6745-4e3b-baf6-4db1c1fcc8d3 tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Acquiring lock "cinder-4323d8a7-9942-4e24-a16c-3f0160c9e831-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "cinder-4323d8a7-9942-4e24-a16c-3f0160c9e831-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Acquiring lock "cinder-quobyte-4323d8a7-9942-4e24-a16c-3f0160c9e831" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "cinder-quobyte-4323d8a7-9942-4e24-a16c-3f0160c9e831" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c710f-6caa-4d2e-8fdf-260941dad25d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:52 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" returned: 0 in 0.516s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:52 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7 Aug 11 06:36:52 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:52 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:52 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:52 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "cinder-quobyte-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7" released by "delete_volume" :: held 0.858s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Created reservations ['6d89ba3c-f605-4c1b-a81a-126e7592aaa2', '006a8f28-5e7b-4f9b-9764-8b73fdcc568c', '185babb0-a6bf-446b-bb1e-5d044d01a364', '3755b40d-04e3-40f5-a415-3882034dc04d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:36:52 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:52 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831 Aug 11 06:36:52 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:52 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:36:52 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:53 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4323d8a7-9942-4e24-a16c-3f0160c9e831" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:53 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.428s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "cinder-quobyte-4323d8a7-9942-4e24-a16c-3f0160c9e831" released by "delete_volume" :: held 1.039s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Deleted volume successfully. Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bc74f66c-7e18-417a-b590-0bd2e58a6ec9 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691" by "attach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bc74f66c-7e18-417a-b590-0bd2e58a6ec9 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691" acquired by "attach_volume" :: waited 0.067s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b3153a50-6e0a-46b7-b181-1f0f4c6bc048 tempest-TestMinimumBasicScenario-279465238 None] Lock "cinder-d2fe5a9b-078a-42f3-8aa6-dd32cf6449e7-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Created reservations ['f343eac2-d4f3-4e21-abfe-59eb047e28ae', 'c9f4b379-927a-4178-8e84-bc0248c6cb2b', '74a48a86-2a43-408d-88cd-356fc2ac1129', 'c37a78fc-9aea-439e-8c30-47a921885eba'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:36:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bc74f66c-7e18-417a-b590-0bd2e58a6ec9 tempest-VolumesActionsTest-985747440 None] Attaching volume d34ca9de-732e-4711-b588-acb6450ae691 to instance bb7a90bb-15d2-4322-a040-581972f50f88 at mountpoint /dev/vdb on host None. Aug 11 06:36:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bc74f66c-7e18-417a-b590-0bd2e58a6ec9 tempest-VolumesActionsTest-985747440 None] Attach volume completed successfully. Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bc74f66c-7e18-417a-b590-0bd2e58a6ec9 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691" released by "attach_volume" :: held 0.188s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:53 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:36:53 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:54 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.636s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:36:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Deleted volume successfully. Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66221bc6-6506-4791-83d8-d3f7f49cabe5 tempest-TestImageHashVerification-1943800700 None] Lock "cinder-4323d8a7-9942-4e24-a16c-3f0160c9e831-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Terminate volume connection completed successfully. Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" by "detach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Detaching volume d34ca9de-732e-4711-b588-acb6450ae691 from instance bb7a90bb-15d2-4322-a040-581972f50f88. Aug 11 06:36:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Detach volume completed successfully. Aug 11 06:36:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e4187938-be84-4f11-9168-21f8793c1d20 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f8812de0-d440-4fea-a9a9-461bd19aff93 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" by "detach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f8812de0-d440-4fea-a9a9-461bd19aff93 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f8812de0-d440-4fea-a9a9-461bd19aff93 tempest-VolumesActionsTest-985747440 None] Volume detach called, but volume not attached. Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f8812de0-d440-4fea-a9a9-461bd19aff93 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-quobyte-d34ca9de-732e-4711-b588-acb6450ae691" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "cinder-quobyte-d34ca9de-732e-4711-b588-acb6450ae691" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf70f51-8288-4544-a41a-3c98ac926463]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:36:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:55 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 Aug 11 06:36:55 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:56 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691" returned: 0 in 0.494s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:56 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691 Aug 11 06:36:56 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:56 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d34ca9de-732e-4711-b588-acb6450ae691" returned: 0 in 0.353s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "cinder-quobyte-d34ca9de-732e-4711-b588-acb6450ae691" released by "delete_volume" :: held 0.922s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Created reservations ['b576b774-3c96-4850-a385-91973f80c9c8', 'e2697c5d-7511-4555-9074-4d4cb69f006d', '78ee11fa-75b6-4ac0-a910-2354c04320a9', '2550b885-0cd1-49ca-a9d1-f8914b71c81e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:36:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:36:56 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:36:56 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:36:57 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Aug 11 06:36:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.585s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:36:57 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:36:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Deleted volume successfully. Aug 11 06:36:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-95e45246-ae69-4f53-82bf-2f6c09cc0716 tempest-VolumesActionsTest-985747440 None] Lock "cinder-d34ca9de-732e-4711-b588-acb6450ae691-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (1f54ad30-69b3-4cae-b613-458a40f9bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77c2fe8-1057-4b58-9e5c-c98c01400af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77c2fe8-1057-4b58-9e5c-c98c01400af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-448654779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086589fb-00e4-4432-b96a-78d2a42d0632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:03Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1965c4b6-a5be-4d24-832a-b070f5256d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1965c4b6-a5be-4d24-832a-b070f5256d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8d6c14-7b45-4ae2-a73b-2235073ada52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8d6c14-7b45-4ae2-a73b-2235073ada52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086589fb-00e4-4432-b96a-78d2a42d0632', 'volume_name': 'volume-086589fb-00e4-4432-b96a-78d2a42d0632', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaa24c1-e304-48d5-8808-f736e60acf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfaa24c1-e304-48d5-8808-f736e60acf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1458f54c-ba40-41b1-90ff-fc47fc65e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Volume 086589fb-00e4-4432-b96a-78d2a42d0632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086589fb-00e4-4432-b96a-78d2a42d0632', 'volume_size': 1} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-448654779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086589fb-00e4-4432-b96a-78d2a42d0632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:03Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Creating volume 086589fb-00e4-4432-b96a-78d2a42d0632 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:03 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 1073741824 Aug 11 06:37:03 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:04 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 1073741824" returned: 0 in 0.940s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:04 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 Aug 11 06:37:04 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:04 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1458f54c-ba40-41b1-90ff-fc47fc65e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086589fb-00e4-4432-b96a-78d2a42d0632', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bb49a6-b938-42a3-98f1-5b664683fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Volume volume-086589fb-00e4-4432-b96a-78d2a42d0632 (086589fb-00e4-4432-b96a-78d2a42d0632): created successfully Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05bb49a6-b938-42a3-98f1-5b664683fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (1f54ad30-69b3-4cae-b613-458a40f9bb38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9ac8bc01-5ed9-4291-a0e0-461e24fc1b26 tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-086589fb-00e4-4432-b96a-78d2a42d0632-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "cinder-086589fb-00e4-4432-b96a-78d2a42d0632-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-quobyte-086589fb-00e4-4432-b96a-78d2a42d0632" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-086589fb-00e4-4432-b96a-78d2a42d0632" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[30caf2e4-c0b9-45c5-9cc8-ce038109ca7e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:05 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 Aug 11 06:37:05 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:06 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:06 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632 Aug 11 06:37:06 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:06 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-086589fb-00e4-4432-b96a-78d2a42d0632" returned: 0 in 0.441s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-086589fb-00e4-4432-b96a-78d2a42d0632" released by "delete_volume" :: held 0.998s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Created reservations ['95a636b3-e068-4612-a766-567838d45b2e', '19d22071-9baf-4b18-b636-c7d2ac46f819', '9eed47bd-cc2d-4d8b-9a53-bf3a9df7647a', '03b83eaa-551c-4817-8073-ee2dda1629f0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:06 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:06 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:07 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:07 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Deleted volume successfully. Aug 11 06:37:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1116a28c-bf65-4345-af10-0a47ffce5e6d tempest-VolumesActionsTest-1948998184 None] Lock "cinder-086589fb-00e4-4432-b96a-78d2a42d0632-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (28698551-5b07-48e5-a8c3-3b77e87c1f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539506c9-fe1a-4f76-87e7-23664219363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539506c9-fe1a-4f76-87e7-23664219363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398013609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed667028-5acb-44d4-b9fd-4c5bcd28ebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:09Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf24774-df23-4518-a9a2-dacb55ae574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf24774-df23-4518-a9a2-dacb55ae574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8f9849-6566-440f-aa90-605eface3f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8f9849-6566-440f-aa90-605eface3f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed667028-5acb-44d4-b9fd-4c5bcd28ebe7', 'volume_name': 'volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45b115c-286a-4923-87e4-6fcb27420873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45b115c-286a-4923-87e4-6fcb27420873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b1060-9a37-4e57-9898-9dc2db9389ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Volume ed667028-5acb-44d4-b9fd-4c5bcd28ebe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7', 'volume_size': 1} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398013609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed667028-5acb-44d4-b9fd-4c5bcd28ebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:09Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Creating volume ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:08 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:09 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 1073741824 Aug 11 06:37:09 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:09 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 1073741824" returned: 0 in 0.847s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:09 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 Aug 11 06:37:09 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:10 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" returned: 0 in 0.338s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b1060-9a37-4e57-9898-9dc2db9389ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9230ae5-159b-40c8-9b7f-5b3006e03168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:10 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Volume volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 (ed667028-5acb-44d4-b9fd-4c5bcd28ebe7): created successfully Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9230ae5-159b-40c8-9b7f-5b3006e03168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (28698551-5b07-48e5-a8c3-3b77e87c1f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c8c5cac5-4119-4d34-a1e9-b41791d0352e tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "cinder-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-quobyte-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe7adbf-ca15-4d36-b69d-126830f8a592]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:11 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 Aug 11 06:37:11 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:11 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" returned: 0 in 0.596s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:11 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7 Aug 11 06:37:11 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:12 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" returned: 0 in 0.452s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7" released by "delete_volume" :: held 1.163s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Created reservations ['718ae805-49a9-4e60-a731-7f2dbef6dc68', '80ef7004-137b-488e-b2e1-c13bd79a1734', '27be5b76-f41a-43cf-b850-051025502aed', '044aae98-5e68-40ab-99f2-1e0d67a9f2fb'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:12 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:12 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:13 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.515s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:13 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Deleted volume successfully. Aug 11 06:37:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f77ddb9b-1fc5-4509-bd8c-525cfe7d87ff tempest-VolumesActionsTest-1948998184 None] Lock "cinder-ed667028-5acb-44d4-b9fd-4c5bcd28ebe7-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (3c02ce4a-4dfa-43b3-a0b5-b2288d0dc0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234ad447-6038-442a-86e3-92b4c8333f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234ad447-6038-442a-86e3-92b4c8333f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079533836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c67fdb-cf3e-4c2a-8901-559aacb73fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:14Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83669752-6274-4799-a244-1f8ae1b429c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83669752-6274-4799-a244-1f8ae1b429c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2fb7d-8fbc-41f9-bac4-adf01c8dc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2fb7d-8fbc-41f9-bac4-adf01c8dc525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c67fdb-cf3e-4c2a-8901-559aacb73fd8', 'volume_name': 'volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47be8b86-8a6b-4f20-bbdb-c52bdd3fc88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47be8b86-8a6b-4f20-bbdb-c52bdd3fc88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23db65c-4984-4e4f-aa47-723ae7b36579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Volume 35c67fdb-cf3e-4c2a-8901-559aacb73fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8', 'volume_size': 1} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079533836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c67fdb-cf3e-4c2a-8901-559aacb73fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:14Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Creating volume 35c67fdb-cf3e-4c2a-8901-559aacb73fd8 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:14 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:14 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 1073741824 Aug 11 06:37:14 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:15 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 1073741824" returned: 0 in 0.606s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:15 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:15 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:15 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 Aug 11 06:37:15 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:15 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:15 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.575s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23db65c-4984-4e4f-aa47-723ae7b36579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f06c-939a-499f-9f1e-a590b01b979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:15 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Volume volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 (35c67fdb-cf3e-4c2a-8901-559aacb73fd8): created successfully Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0924f06c-939a-499f-9f1e-a590b01b979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (3c02ce4a-4dfa-43b3-a0b5-b2288d0dc0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a750d9bf-651c-4b0f-bc9e-06abf9d74fb4 tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:37:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-35c67fdb-cf3e-4c2a-8901-559aacb73fd8-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-35c67fdb-cf3e-4c2a-8901-559aacb73fd8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-quobyte-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8040fb-5138-4f2a-90a0-28168c7e8846]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:17 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 Aug 11 06:37:17 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:17 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" returned: 0 in 0.530s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:17 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8 Aug 11 06:37:17 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:17 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-35c67fdb-cf3e-4c2a-8901-559aacb73fd8" released by "delete_volume" :: held 1.006s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Created reservations ['553bd679-fe44-40b2-9524-1b96ef093937', 'd2eb4bca-fa00-417d-aa35-1f316ea88374', '7a603b47-db66-4ccb-9a06-896e97ffc633', '87117d64-d60c-4be5-9b9b-db0af352745c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:18 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:18 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:18 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Deleted volume successfully. Aug 11 06:37:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-262ef7ce-07a3-46fe-830f-fc8eff680539 tempest-VolumesActionsTest-1948998184 None] Lock "cinder-35c67fdb-cf3e-4c2a-8901-559aacb73fd8-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (c9a5015e-78bd-49a1-8e46-e167213c31dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77ef11e-4c2e-4121-a99a-1c56b860d821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77ef11e-4c2e-4121-a99a-1c56b860d821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664120415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e936dd4b-bd75-4ffb-a9b5-8eae6b094c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:20Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26217823-9c48-4015-8be1-45f50bf4e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26217823-9c48-4015-8be1-45f50bf4e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3294d0a5-5d58-4f31-aeb9-460103baf621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3294d0a5-5d58-4f31-aeb9-460103baf621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e936dd4b-bd75-4ffb-a9b5-8eae6b094c42', 'volume_name': 'volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e08b5f-9a91-4b24-92ad-64127a7bdef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e08b5f-9a91-4b24-92ad-64127a7bdef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c157de-ed63-4fce-a91c-031f0891099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:19 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Volume e936dd4b-bd75-4ffb-a9b5-8eae6b094c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42', 'volume_size': 1} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1664120415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e936dd4b-bd75-4ffb-a9b5-8eae6b094c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:20Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Creating volume e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:19 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:19 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 1073741824 Aug 11 06:37:19 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:20 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 1073741824" returned: 0 in 0.542s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:20 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 Aug 11 06:37:20 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:20 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c157de-ed63-4fce-a91c-031f0891099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae6ac67-eef3-4cdf-90e6-32026667ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:20 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Volume volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 (e936dd4b-bd75-4ffb-a9b5-8eae6b094c42): created successfully Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae6ac67-eef3-4cdf-90e6-32026667ec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (c9a5015e-78bd-49a1-8e46-e167213c31dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d2dc38ab-1e98-4b69-a9b3-82a393bce58e tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:37:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "cinder-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Acquiring lock "cinder-quobyte-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e3382-1347-4d02-ae3e-d66f8b64966c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:22 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 Aug 11 06:37:22 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:22 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:22 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42 Aug 11 06:37:22 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:22 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" returned: 0 in 0.306s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "cinder-quobyte-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42" released by "delete_volume" :: held 0.809s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Created reservations ['f01d65ff-f6b7-4e5b-af61-8ed6f8c11ab3', '744ab700-5618-48de-bdfb-78f05d225709', '4c2baa0b-f197-4b17-981a-369fe75d794f', '5552252d-e0b2-446d-a8aa-bdaf5f8394db'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:23 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:23 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:23 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Deleted volume successfully. Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6b16e787-be64-4215-8fd9-ce6d558fe33c tempest-VolumesActionsTest-1948998184 None] Lock "cinder-e936dd4b-bd75-4ffb-a9b5-8eae6b094c42-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (37172766-7fe5-4775-9253-5763cdff810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816327cb-180d-4e09-b66a-9b86f9ff7225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816327cb-180d-4e09-b66a-9b86f9ff7225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183978297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457bb554-8ff0-4e0d-947d-bec8f08aa904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:24Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea24b35-169d-416d-accb-36b21ca72051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea24b35-169d-416d-accb-36b21ca72051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cdc891-f55b-4ffe-8c31-ff88eae505d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cdc891-f55b-4ffe-8c31-ff88eae505d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '457bb554-8ff0-4e0d-947d-bec8f08aa904', 'volume_name': 'volume-457bb554-8ff0-4e0d-947d-bec8f08aa904', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407ad5d-9b8f-45c0-a2b6-ccc5e43df8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7407ad5d-9b8f-45c0-a2b6-ccc5e43df8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143672d6-205e-40e3-a12e-11327da96dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Volume 457bb554-8ff0-4e0d-947d-bec8f08aa904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-457bb554-8ff0-4e0d-947d-bec8f08aa904', 'volume_size': 1} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183978297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=457bb554-8ff0-4e0d-947d-bec8f08aa904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f337eb8f72841169cd6477ed80fc0f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:24Z,use_quota=True,user_id='6c2751fc10874e51966f32f9eb9c4ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Creating volume 457bb554-8ff0-4e0d-947d-bec8f08aa904 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:24 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:24 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 1073741824 Aug 11 06:37:24 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:24 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 1073741824" returned: 0 in 0.523s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:24 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 Aug 11 06:37:24 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:24 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904" returned: 0 in 0.299s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143672d6-205e-40e3-a12e-11327da96dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-457bb554-8ff0-4e0d-947d-bec8f08aa904', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c60268-2a2e-45a6-8c64-163f36c7cd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Volume volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 (457bb554-8ff0-4e0d-947d-bec8f08aa904): created successfully Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c60268-2a2e-45a6-8c64-163f36c7cd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Flow 'volume_create_manager' (37172766-7fe5-4775-9253-5763cdff810f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:24 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-cf15c48f-fdbc-4209-abb8-5261dd5405de tempest-VolumesActionsTest-985747440 None] Created volume successfully. Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-457bb554-8ff0-4e0d-947d-bec8f08aa904-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "cinder-457bb554-8ff0-4e0d-947d-bec8f08aa904-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Acquiring lock "cinder-quobyte-457bb554-8ff0-4e0d-947d-bec8f08aa904" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "cinder-quobyte-457bb554-8ff0-4e0d-947d-bec8f08aa904" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b7dbc-7ccb-4501-bb56-4e3995a61fe1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:27 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 Aug 11 06:37:27 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:27 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904" returned: 0 in 0.549s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:27 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904 Aug 11 06:37:27 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:28 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-457bb554-8ff0-4e0d-947d-bec8f08aa904" returned: 0 in 0.358s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "cinder-quobyte-457bb554-8ff0-4e0d-947d-bec8f08aa904" released by "delete_volume" :: held 0.987s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Created reservations ['05614dfa-6488-4db4-9ff9-c45eea7a7b12', '3730f108-9a4c-4308-9e66-f9f2792e8cae', '026a234b-546b-4e2a-8855-e6b6aad456b7', 'f246fa85-baec-404a-9dea-26a5a7bd40c4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:28 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:37:28 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:29 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.513s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:29 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:37:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Deleted volume successfully. Aug 11 06:37:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4d56d0f3-09b4-4a8d-bfd3-5573d6d5c751 tempest-VolumesActionsTest-985747440 None] Lock "cinder-457bb554-8ff0-4e0d-947d-bec8f08aa904-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (2181d243-a8ce-441c-8302-6e9ae63b17be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b5757-1329-43c9-9d03-f58fbfa9edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8b5757-1329-43c9-9d03-f58fbfa9edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1965100224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff7019-5785-486b-98c2-a395de766fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:33Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea26162-aa92-46b2-9288-d626a0170986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea26162-aa92-46b2-9288-d626a0170986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6776d-bd19-46a7-85fc-6649e2b0b9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f6776d-bd19-46a7-85fc-6649e2b0b9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ff7019-5785-486b-98c2-a395de766fad', 'volume_name': 'volume-27ff7019-5785-486b-98c2-a395de766fad', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ede3e99-5001-4b7a-92ec-650b8a38f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ede3e99-5001-4b7a-92ec-650b8a38f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f61116-93f3-4d80-8cb1-727c35bec45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Volume 27ff7019-5785-486b-98c2-a395de766fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ff7019-5785-486b-98c2-a395de766fad', 'volume_size': 1} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1965100224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ff7019-5785-486b-98c2-a395de766fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:33Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Creating volume 27ff7019-5785-486b-98c2-a395de766fad {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:32 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:32 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad 1073741824 Aug 11 06:37:32 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:33 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad 1073741824" returned: 0 in 0.562s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:33 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad Aug 11 06:37:33 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:33 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad" returned: 0 in 0.350s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f61116-93f3-4d80-8cb1-727c35bec45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ff7019-5785-486b-98c2-a395de766fad', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5466d09-433b-4fa4-9367-75696c7850df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Volume volume-27ff7019-5785-486b-98c2-a395de766fad (27ff7019-5785-486b-98c2-a395de766fad): created successfully Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5466d09-433b-4fa4-9367-75696c7850df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (2181d243-a8ce-441c-8302-6e9ae63b17be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6c88be33-859e-4c0c-bda4-b7f5f3fbd168 tempest-AttachVolumeTestJSON-2076597861 None] Created volume successfully. Aug 11 06:37:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-711bcff3-74a4-4532-b677-085f0d3d4404 req-a286e833-675f-4a4b-9336-b1c2acbf4d4b tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-711bcff3-74a4-4532-b677-085f0d3d4404 req-a286e833-675f-4a4b-9336-b1c2acbf4d4b tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-711bcff3-74a4-4532-b677-085f0d3d4404 req-a286e833-675f-4a4b-9336-b1c2acbf4d4b tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-711bcff3-74a4-4532-b677-085f0d3d4404 req-a286e833-675f-4a4b-9336-b1c2acbf4d4b tempest-AttachVolumeTestJSON-2076597861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-27ff7019-5785-486b-98c2-a395de766fad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85f21aba-3e04-4502-bd8c-2006b7a4e0f1', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:37:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-711bcff3-74a4-4532-b677-085f0d3d4404 req-a286e833-675f-4a4b-9336-b1c2acbf4d4b tempest-AttachVolumeTestJSON-2076597861 None] attachment_update completed successfully. Aug 11 06:37:41 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=70,cinder:UPDATE=86,cinder:INSERT=18,cinder:DELETE=8 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:37:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=68,cinder:UPDATE=95,cinder:INSERT=23,cinder:DELETE=7 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Flow 'volume_create_manager' (4e0e6b75-ad9a-4cf1-bce5-120cf9f4f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a91fda-b011-4d37-81b3-0700e0e90764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a91fda-b011-4d37-81b3-0700e0e90764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1802899169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be4184e-f903-4597-bbe7-b2b45613ad4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40aa61c512f4555b42a038c36e5181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:53Z,use_quota=True,user_id='eec75757a7774dcc9fb3b96e2a5d2262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608db83-4b02-48ba-aaa4-ae8319e064d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608db83-4b02-48ba-aaa4-ae8319e064d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dfcd59-d550-4df4-9ddd-01d5713c1a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dfcd59-d550-4df4-9ddd-01d5713c1a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be4184e-f903-4597-bbe7-b2b45613ad4c', 'volume_name': 'volume-1be4184e-f903-4597-bbe7-b2b45613ad4c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79191113-9004-4fea-9492-1c70c7cfefbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79191113-9004-4fea-9492-1c70c7cfefbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4e7075-50d7-4b6c-bcf3-0d99a744a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Volume 1be4184e-f903-4597-bbe7-b2b45613ad4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be4184e-f903-4597-bbe7-b2b45613ad4c', 'volume_size': 1} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1802899169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be4184e-f903-4597-bbe7-b2b45613ad4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40aa61c512f4555b42a038c36e5181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:53Z,use_quota=True,user_id='eec75757a7774dcc9fb3b96e2a5d2262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Creating volume 1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:53 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:53 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c 1073741824 Aug 11 06:37:53 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:54 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c 1073741824" returned: 0 in 0.653s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:54 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:37:54 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:54 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4e7075-50d7-4b6c-bcf3-0d99a744a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be4184e-f903-4597-bbe7-b2b45613ad4c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819fd2d7-241a-4b56-9fa6-eead1c834d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Volume volume-1be4184e-f903-4597-bbe7-b2b45613ad4c (1be4184e-f903-4597-bbe7-b2b45613ad4c): created successfully Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819fd2d7-241a-4b56-9fa6-eead1c834d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Flow 'volume_create_manager' (4e0e6b75-ad9a-4cf1-bce5-120cf9f4f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-397eba86-96b0-46f3-803c-d9ab5684501d tempest-TestStampPattern-1257866422 None] Created volume successfully. Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Flow 'volume_create_manager' (816ba175-5812-476c-8180-4aa73fc1e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd7dbb-a2e7-48e1-9a28-8d9e4d4550ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd7dbb-a2e7-48e1-9a28-8d9e4d4550ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1576804570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558c0133-3f90-4a21-9bab-4f37b0a132e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3fc8d3e388411193389fd066594052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:56Z,use_quota=True,user_id='e780d864e91245a081c3ece2bce5031f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e482ea-cfe8-4a56-a3b1-d72a7d1c757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e482ea-cfe8-4a56-a3b1-d72a7d1c757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bab532-0784-48e2-8b50-32a409b0dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bab532-0784-48e2-8b50-32a409b0dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '558c0133-3f90-4a21-9bab-4f37b0a132e7', 'volume_name': 'volume-558c0133-3f90-4a21-9bab-4f37b0a132e7', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ecc981-7f8b-4882-9670-ec01a1e4b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ecc981-7f8b-4882-9670-ec01a1e4b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f66a12-00bd-48b2-b244-52c7a89686cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Volume 558c0133-3f90-4a21-9bab-4f37b0a132e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-558c0133-3f90-4a21-9bab-4f37b0a132e7', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 06:37:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Trying to clone 558c0133-3f90-4a21-9bab-4f37b0a132e7 from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Flow 'volume_create_manager' (c0de098c-f8e9-4e27-bcb8-56f9a550950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64376e6f-61cb-46e1-9310-84bbeba6e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64376e6f-61cb-46e1-9310-84bbeba6e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148739880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafb4d31-e621-4709-9d3f-78cfa66fcb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4352cd196474f44a87068a55eaa4197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:57Z,use_quota=True,user_id='26f46883bfd344299d0598a902da1e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0208cce-c706-45eb-ac77-d04f68021a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0208cce-c706-45eb-ac77-d04f68021a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647f80e3-a657-4fc0-98eb-af8032216dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:37:57 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Image download 20.69 MB at 20.69 MB/s Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[047efad6-86d5-4750-827f-553ff3db6123]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:57 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD Aug 11 06:37:57 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647f80e3-a657-4fc0-98eb-af8032216dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fafb4d31-e621-4709-9d3f-78cfa66fcb86', 'volume_name': 'volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866a4aef-e84f-4ae3-a8c3-e7975ff3784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866a4aef-e84f-4ae3-a8c3-e7975ff3784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a7246c-5cd2-4d46-8ab7-2a130c161800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:37:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Volume fafb4d31-e621-4709-9d3f-78cfa66fcb86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 06:37:57 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Trying to clone fafb4d31-e621-4709-9d3f-78cfa66fcb86 from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:37:58 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 is fetched for user e780d864e91245a081c3ece2bce5031f. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6852595-2a0f-42c7-b01d-80546dc26418]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:37:58 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Image download 20.69 MB at 20.69 MB/s Aug 11 06:37:58 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD Aug 11 06:37:58 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7fc81f-b948-446a-91e2-e0940eb4e961]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:59 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD Aug 11 06:37:59 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:59 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1576804570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=558c0133-3f90-4a21-9bab-4f37b0a132e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3fc8d3e388411193389fd066594052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:56Z,use_quota=True,user_id='e780d864e91245a081c3ece2bce5031f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Creating volume 558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:37:59 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:59 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1073741824 Aug 11 06:37:59 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:37:59 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 is fetched for user 26f46883bfd344299d0598a902da1e65. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eecacb-34fd-491c-a014-044c6c7cad7c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:37:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:37:59 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD Aug 11 06:37:59 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:00 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1073741824" returned: 0 in 0.699s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:00 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 Aug 11 06:38:00 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:00 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:00 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7" returned: 0 in 0.350s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.254s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148739880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafb4d31-e621-4709-9d3f-78cfa66fcb86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4352cd196474f44a87068a55eaa4197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:37:57Z,use_quota=True,user_id='26f46883bfd344299d0598a902da1e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Creating volume fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:38:00 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Attempting download of b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 558c0133-3f90-4a21-9bab-4f37b0a132e7. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:38:00 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1073741824 Aug 11 06:38:00 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a490c-d1ee-4ab0-9ef2-d873e31e1738]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:00 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk Aug 11 06:38:00 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:01 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk" returned: 0 in 0.405s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:01 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1073741824" returned: 0 in 0.683s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:01 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk Aug 11 06:38:01 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:01 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 Aug 11 06:38:01 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:01 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86" returned: 0 in 0.637s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:01 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Attempting download of b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume fafb4d31-e621-4709-9d3f-78cfa66fcb86. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:38:02 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk" returned: 1 in 0.955s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wullgqkk' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[44605e9d-6d20-4107-8bce-3384f34864fd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1cbe26-f36d-495d-80a9-12ed11ecfeb0]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:02 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0 Aug 11 06:38:02 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:02 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD Aug 11 06:38:02 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:02 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0" returned: 0 in 0.534s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:02 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0 Aug 11 06:38:02 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:03 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] b9bfbb5e-34f5-42dc-847f-82185f2020b1 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:03 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 Aug 11 06:38:03 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:03 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0" returned: 1 in 0.651s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_8j7w_bz0' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d751af-706f-4b20-be5e-b56d302e5ad2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:03 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD Aug 11 06:38:03 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:03 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] b9bfbb5e-34f5-42dc-847f-82185f2020b1 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:38:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:03 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 Aug 11 06:38:03 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:05 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7" returned: 0 in 2.876s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:05 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_x0d067xydevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:38:05 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Converted 112.00 MB image at 38.92 MB/s Aug 11 06:38:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:05 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1G Aug 11 06:38:05 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:06 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 1G" returned: 0 in 0.564s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Downloaded image b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 558c0133-3f90-4a21-9bab-4f37b0a132e7 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 for user e780d864e91245a081c3ece2bce5031f is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Marking volume 558c0133-3f90-4a21-9bab-4f37b0a132e7 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Copying metadata from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 to 558c0133-3f90-4a21-9bab-4f37b0a132e7. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Creating volume glance metadata for volume 558c0133-3f90-4a21-9bab-4f37b0a132e7 backed by image b9bfbb5e-34f5-42dc-847f-82185f2020b1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f66a12-00bd-48b2-b244-52c7a89686cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558c0133-3f90-4a21-9bab-4f37b0a132e7', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26feee2-3b51-4a7c-ab5d-05668ef81de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Volume volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 (558c0133-3f90-4a21-9bab-4f37b0a132e7): created successfully Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26feee2-3b51-4a7c-ab5d-05668ef81de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Flow 'volume_create_manager' (816ba175-5812-476c-8180-4aa73fc1e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1a35e90a-1de4-4ff0-ba72-7879ca762cdb tempest-TestShelveInstance-1534789965 None] Created volume successfully. Aug 11 06:38:06 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86" returned: 0 in 2.882s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_wwmqqr7zdevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:38:06 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Converted 112.00 MB image at 38.85 MB/s Aug 11 06:38:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:06 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1G Aug 11 06:38:06 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:07 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 1G" returned: 0 in 0.460s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Downloaded image b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume fafb4d31-e621-4709-9d3f-78cfa66fcb86 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 for user 26f46883bfd344299d0598a902da1e65 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Marking volume fafb4d31-e621-4709-9d3f-78cfa66fcb86 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Copying metadata from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 to fafb4d31-e621-4709-9d3f-78cfa66fcb86. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Creating volume glance metadata for volume fafb4d31-e621-4709-9d3f-78cfa66fcb86 backed by image b9bfbb5e-34f5-42dc-847f-82185f2020b1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a7246c-5cd2-4d46-8ab7-2a130c161800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0748673e-01ba-41ef-acb6-f16eb8231a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:07 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Volume volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 (fafb4d31-e621-4709-9d3f-78cfa66fcb86): created successfully Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0748673e-01ba-41ef-acb6-f16eb8231a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Flow 'volume_create_manager' (c0de098c-f8e9-4e27-bcb8-56f9a550950e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dec3c318-4ee0-41f1-af04-b828ab8ec2d3 tempest-VolumesImageMetadata-1321178996 None] Created volume successfully. Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Acquiring lock "cinder-fafb4d31-e621-4709-9d3f-78cfa66fcb86-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "cinder-fafb4d31-e621-4709-9d3f-78cfa66fcb86-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Acquiring lock "cinder-quobyte-fafb4d31-e621-4709-9d3f-78cfa66fcb86" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "cinder-quobyte-fafb4d31-e621-4709-9d3f-78cfa66fcb86" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7dc43f-229b-4bfc-bdbc-56f0da00a90e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:09 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 Aug 11 06:38:09 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:10 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86" returned: 0 in 0.630s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:10 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86 Aug 11 06:38:10 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:10 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-fafb4d31-e621-4709-9d3f-78cfa66fcb86" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "cinder-quobyte-fafb4d31-e621-4709-9d3f-78cfa66fcb86" released by "delete_volume" :: held 1.246s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Created reservations ['05433110-fe6e-451f-987b-7bcae159eac7', '6ee22ef5-db12-462e-80b3-a5091263fd96', 'c6c1c6e2-ef2e-42ca-b0dd-11fa0ee0cab1', 'f77b2dd7-70b2-480d-a7a0-041f50bc6022'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:11 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:38:11 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:11 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.560s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:38:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Deleted volume successfully. Aug 11 06:38:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82d7dcf1-a250-4029-8294-dee8260d54a1 tempest-VolumesImageMetadata-1321178996 None] Lock "cinder-fafb4d31-e621-4709-9d3f-78cfa66fcb86-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-5374c664-5ed7-46ba-b666-e57728786e1d req-8dbbbfe1-d398-43a7-9697-30dac1a17a36 tempest-TestShelveInstance-1534789965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-5374c664-5ed7-46ba-b666-e57728786e1d req-8dbbbfe1-d398-43a7-9697-30dac1a17a36 tempest-TestShelveInstance-1534789965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-5374c664-5ed7-46ba-b666-e57728786e1d req-8dbbbfe1-d398-43a7-9697-30dac1a17a36 tempest-TestShelveInstance-1534789965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-5374c664-5ed7-46ba-b666-e57728786e1d req-8dbbbfe1-d398-43a7-9697-30dac1a17a36 tempest-TestShelveInstance-1534789965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-558c0133-3f90-4a21-9bab-4f37b0a132e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7be6efc3-06f8-4f4c-8fb6-886e16637c94', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:38:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-5374c664-5ed7-46ba-b666-e57728786e1d req-8dbbbfe1-d398-43a7-9697-30dac1a17a36 tempest-TestShelveInstance-1534789965 None] attachment_update completed successfully. Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:15 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:38:15 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:15 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.481s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:38:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Flow 'volume_create_manager' (88948206-51ba-4436-b7c0-740755b3a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614640-9ddb-4f7e-b88d-83f8fbec2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16614640-9ddb-4f7e-b88d-83f8fbec2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-171328251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542bb9af-64f4-4a13-8dee-7488cad58a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c3a0bb52eb43a499296ea5a99d8d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:17Z,use_quota=True,user_id='e0bb026789dc4a448a66782177c8a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0585b8d5-c6ad-41c8-a395-f76cbf736a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0585b8d5-c6ad-41c8-a395-f76cbf736a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a94c05-7fa5-4ecf-b342-8a2c83e3e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a94c05-7fa5-4ecf-b342-8a2c83e3e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542bb9af-64f4-4a13-8dee-7488cad58a94', 'volume_name': 'volume-542bb9af-64f4-4a13-8dee-7488cad58a94', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d5cb58-2e01-49f3-bced-cd1de19b1b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d5cb58-2e01-49f3-bced-cd1de19b1b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c8083-1aec-4347-8c27-72ed924055c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:16 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Volume 542bb9af-64f4-4a13-8dee-7488cad58a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542bb9af-64f4-4a13-8dee-7488cad58a94', 'volume_size': 1} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-171328251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542bb9af-64f4-4a13-8dee-7488cad58a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c3a0bb52eb43a499296ea5a99d8d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:17Z,use_quota=True,user_id='e0bb026789dc4a448a66782177c8a00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Creating volume 542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:38:17 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:38:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:17 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 1073741824 Aug 11 06:38:17 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:17 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 1073741824" returned: 0 in 0.941s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:18 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 Aug 11 06:38:18 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:18 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c8083-1aec-4347-8c27-72ed924055c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542bb9af-64f4-4a13-8dee-7488cad58a94', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab12526-2164-4dd7-8bfc-756cfe2c9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:18 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Volume volume-542bb9af-64f4-4a13-8dee-7488cad58a94 (542bb9af-64f4-4a13-8dee-7488cad58a94): created successfully Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab12526-2164-4dd7-8bfc-756cfe2c9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Flow 'volume_create_manager' (88948206-51ba-4436-b7c0-740755b3a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3758f963-1c70-4702-8402-a7309cab4d0e tempest-SnapshotMetadataTestJSON-928399071 None] Created volume successfully. Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Creating offline snapshot 5c05a08b-0a57-4f68-8668-9ff3c93d056f of volume 542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1871dd25-5e2e-45df-95bd-c9fe032f2226]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:19 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 Aug 11 06:38:19 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:19 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94" returned: 0 in 0.570s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:19 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f 1G Aug 11 06:38:19 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:20 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f 1G" returned: 0 in 0.786s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bb9af-64f4-4a13-8dee-7488cad58a94 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:20 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bb9af-64f4-4a13-8dee-7488cad58a94 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f Aug 11 06:38:20 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:20 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bb9af-64f4-4a13-8dee-7488cad58a94 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:20 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f is being set with open permissions: ugo+rw Aug 11 06:38:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:20 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f Aug 11 06:38:20 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:21 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:21 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info Aug 11 06:38:21 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:21 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info" returned: 0 in 0.300s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:21 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info is being set with open permissions: ugo+rw Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:21 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info Aug 11 06:38:21 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:21 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.info" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6021620a-b61a-4b06-b43f-b3740702ee4c tempest-SnapshotMetadataTestJSON-928399071 None] Create snapshot completed successfully Aug 11 06:38:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-784e9d45-f329-4608-8bea-c00c34f97835 req-d30696c4-fc25-4f1a-b66f-0b587dcb7cc1 tempest-AttachVolumeTestJSON-2076597861 None] Terminate volume connection completed successfully. Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-784e9d45-f329-4608-8bea-c00c34f97835 req-d30696c4-fc25-4f1a-b66f-0b587dcb7cc1 tempest-AttachVolumeTestJSON-2076597861 None] Deleting attachment 85f21aba-3e04-4502-bd8c-2006b7a4e0f1. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "cinder-5c05a08b-0a57-4f68-8668-9ff3c93d056f-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-5c05a08b-0a57-4f68-8668-9ff3c93d056f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "cinder-quobyte-5c05a08b-0a57-4f68-8668-9ff3c93d056f" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-5c05a08b-0a57-4f68-8668-9ff3c93d056f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Deleting offline snapshot 5c05a08b-0a57-4f68-8668-9ff3c93d056f of volume 542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] snapshot_file for this snap is: volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e007c4-99e3-4583-9ba6-5e2b97181cc2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:23 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f Aug 11 06:38:23 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:24 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f" returned: 0 in 0.664s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542bb9af-64f4-4a13-8dee-7488cad58a94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9dc15-1d29-480f-a0b2-8403bf61ce07]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:24 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 Aug 11 06:38:24 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:24 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94" returned: 0 in 0.518s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:24 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f Aug 11 06:38:24 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:25 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:25 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f Aug 11 06:38:25 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:25 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94.5c05a08b-0a57-4f68-8668-9ff3c93d056f" returned: 0 in 0.308s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-5c05a08b-0a57-4f68-8668-9ff3c93d056f" released by "_delete_snapshot" :: held 2.109s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" released by "delete_snapshot" :: held 2.164s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Created reservations ['b2e71f67-9fc2-477e-8d5a-2da47766750b', '4b32f970-ac51-4df4-9d3f-89412a969910', 'f5ec6285-f222-432a-af37-b18e3e76a8d5', 'a70dc435-3e76-448e-9c58-f05db1bda16c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Delete snapshot completed successfully. Aug 11 06:38:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2b68244f-e87c-4c81-ae9a-ab4f18eadaa2 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-5c05a08b-0a57-4f68-8668-9ff3c93d056f-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "cinder-542bb9af-64f4-4a13-8dee-7488cad58a94-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-542bb9af-64f4-4a13-8dee-7488cad58a94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" acquired by "delete_volume" :: waited 0.062s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:27 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[61870acc-16ba-469d-8037-aac9e3b36a52]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:27 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 Aug 11 06:38:27 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:27 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94" returned: 0 in 0.889s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:27 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94 Aug 11 06:38:27 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:28 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-542bb9af-64f4-4a13-8dee-7488cad58a94" returned: 0 in 0.420s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-quobyte-542bb9af-64f4-4a13-8dee-7488cad58a94" released by "delete_volume" :: held 1.559s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Created reservations ['0f93160f-c524-421a-8056-680cba1fb611', '1f44363f-a7b5-48a7-8b79-d5b9db27f1ae', '5aa94f86-895f-48ba-a9c7-aee106e401ba', 'f8256e47-8e37-4aff-a522-dca2f77fc55e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:28 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:38:28 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:29 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.702s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:29 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:38:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Deleted volume successfully. Aug 11 06:38:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c01621b-5a3f-489a-b7e9-fe94320666c8 tempest-SnapshotMetadataTestJSON-928399071 None] Lock "cinder-542bb9af-64f4-4a13-8dee-7488cad58a94-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-da13d804-c167-4041-9c5f-8a23fc0dd385 req-04c0c7f1-73ec-4eb2-8f63-2d7432f98bb3 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-da13d804-c167-4041-9c5f-8a23fc0dd385 req-04c0c7f1-73ec-4eb2-8f63-2d7432f98bb3 tempest-TestStampPattern-1257866422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-da13d804-c167-4041-9c5f-8a23fc0dd385 req-04c0c7f1-73ec-4eb2-8f63-2d7432f98bb3 tempest-TestStampPattern-1257866422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-da13d804-c167-4041-9c5f-8a23fc0dd385 req-04c0c7f1-73ec-4eb2-8f63-2d7432f98bb3 tempest-TestStampPattern-1257866422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-1be4184e-f903-4597-bbe7-b2b45613ad4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfc1088b-e166-45eb-8e03-9b64a61771fb', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:38:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-da13d804-c167-4041-9c5f-8a23fc0dd385 req-04c0c7f1-73ec-4eb2-8f63-2d7432f98bb3 tempest-TestStampPattern-1257866422 None] attachment_update completed successfully. Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (3738728e-f625-4b93-a9ab-74cfb7aa289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a14a90-c5e4-4873-8ac0-0f6ba6a61fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a14a90-c5e4-4873-8ac0-0f6ba6a61fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1146491794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab921be9-9978-45ca-b058-2b04b29989e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e545f2604a504bd8b2cec95e02372f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:33Z,use_quota=True,user_id='ec263ad3076e48188b396b5f20a87ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8928ab33-823c-4ae1-be01-e7e12c4c6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8928ab33-823c-4ae1-be01-e7e12c4c6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe78674-7c3d-483d-b3ae-c4f893c15401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe78674-7c3d-483d-b3ae-c4f893c15401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab921be9-9978-45ca-b058-2b04b29989e2', 'volume_name': 'volume-ab921be9-9978-45ca-b058-2b04b29989e2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0313cea9-b02f-4dbc-8ecd-fc09eb612ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0313cea9-b02f-4dbc-8ecd-fc09eb612ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0917489-10fc-4998-a7f2-03c13724178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Volume ab921be9-9978-45ca-b058-2b04b29989e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab921be9-9978-45ca-b058-2b04b29989e2', 'volume_size': 1} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1146491794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab921be9-9978-45ca-b058-2b04b29989e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e545f2604a504bd8b2cec95e02372f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:33Z,use_quota=True,user_id='ec263ad3076e48188b396b5f20a87ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Creating volume ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:38:33 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:38:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:33 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 1073741824 Aug 11 06:38:33 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:34 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 1073741824" returned: 0 in 0.569s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:34 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:34 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:34 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.283s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0917489-10fc-4998-a7f2-03c13724178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab921be9-9978-45ca-b058-2b04b29989e2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34807408-de82-4263-8a40-111bd21612fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:34 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Volume volume-ab921be9-9978-45ca-b058-2b04b29989e2 (ab921be9-9978-45ca-b058-2b04b29989e2): created successfully Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34807408-de82-4263-8a40-111bd21612fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (3738728e-f625-4b93-a9ab-74cfb7aa289d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d65bd328-e716-4eea-a019-35bab58d2ce4 tempest-VolumesDeleteCascade-1698647485 None] Created volume successfully. Aug 11 06:38:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Creating offline snapshot 7b164ddd-808a-4cc3-a16a-a3db3ffa892a of volume ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:38:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a00d29-5dc2-425f-a75f-34be779e5eef]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:36 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:36 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:36 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:36 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a 1G Aug 11 06:38:36 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:36 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a 1G" returned: 0 in 0.516s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:36 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:36 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:37 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.344s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a is being set with open permissions: ugo+rw Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:37 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:37 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:37 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:37 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info Aug 11 06:38:37 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:37 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info" returned: 0 in 0.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info is being set with open permissions: ugo+rw Aug 11 06:38:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:37 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info Aug 11 06:38:37 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:38 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.info" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-064170cb-24b1-4692-86d4-af09b353417c tempest-VolumesDeleteCascade-1698647485 None] Create snapshot completed successfully Aug 11 06:38:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-7e6f91de-f970-4303-8cf6-70c36399a580 req-c742b9e2-6010-401d-9a49-2bf09f493dbd tempest-TestStampPattern-1257866422 None] Terminate volume connection completed successfully. Aug 11 06:38:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-7e6f91de-f970-4303-8cf6-70c36399a580 req-c742b9e2-6010-401d-9a49-2bf09f493dbd tempest-TestStampPattern-1257866422 None] Deleting attachment cfc1088b-e166-45eb-8e03-9b64a61771fb. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Creating offline snapshot 9c0cb432-6522-4a37-b6d9-84acafb68c3a of volume ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c4780-753f-499c-9373-759018373baf]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:39 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:39 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:39 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab921be9-9978-45ca-b058-2b04b29989e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:39 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a 1G Aug 11 06:38:39 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:40 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a 1G" returned: 0 in 0.421s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:40 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:40 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:40 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:40 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a is being set with open permissions: ugo+rw Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:40 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:40 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:40 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.294s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.574s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.087s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Creating offline snapshot 264d66a3-0afc-48db-9f50-1a5d928a767b of volume 1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:38:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-21f3ece1-bc96-4ac5-9d09-de44b51419cf tempest-VolumesDeleteCascade-1698647485 None] Create snapshot completed successfully Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[202f00e3-9a3f-4de9-9d10-7754b8364c83]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:40 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:38:40 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:41 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.384s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:41 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b 1G Aug 11 06:38:41 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-ab921be9-9978-45ca-b058-2b04b29989e2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-ab921be9-9978-45ca-b058-2b04b29989e2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Performing cascade delete. {{(pid=94463) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-7b164ddd-808a-4cc3-a16a-a3db3ffa892a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-7b164ddd-808a-4cc3-a16a-a3db3ffa892a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-7b164ddd-808a-4cc3-a16a-a3db3ffa892a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-7b164ddd-808a-4cc3-a16a-a3db3ffa892a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Deleting offline snapshot 7b164ddd-808a-4cc3-a16a-a3db3ffa892a of volume ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] snapshot_file for this snap is: volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05cfac-dac9-47a5-aad8-49e4b32a1fff]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:41 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b 1G" returned: 0 in 0.501s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be4184e-f903-4597-bbe7-b2b45613ad4c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:41 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be4184e-f903-4597-bbe7-b2b45613ad4c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:38:41 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:41 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:41 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be4184e-f903-4597-bbe7-b2b45613ad4c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.294s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b is being set with open permissions: ugo+rw Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:42 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:38:42 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.428s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab921be9-9978-45ca-b058-2b04b29989e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f230c-272f-420d-b051-e14fff63f842]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:42 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:42 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:42 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info Aug 11 06:38:42 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.414s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b419b7-25ba-44be-ae61-c06ea2cfc477]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:42 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info" returned: 0 in 0.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info is being set with open permissions: ugo+rw Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:42 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info Aug 11 06:38:42 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:42 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:42 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.info" returned: 0 in 0.276s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-70551c26-6e70-402e-85d2-0652ba5f202f tempest-TestStampPattern-1257866422 None] Create snapshot completed successfully Aug 11 06:38:43 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.457s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab921be9-9978-45ca-b058-2b04b29989e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb26db-04cc-49c0-8a6e-30b4abd489ea]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:43 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:43 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:43 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab921be9-9978-45ca-b058-2b04b29989e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08ffe3-8808-4bb8-aee9-65fcee9e84a2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:43 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:43 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:43 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:43 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:43 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:44 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.471s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:44 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a Aug 11 06:38:44 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:44 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.7b164ddd-808a-4cc3-a16a-a3db3ffa892a" returned: 0 in 0.409s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a -F qcow2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:44 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a -F qcow2 Aug 11 06:38:44 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:45 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab921be9-9978-45ca-b058-2b04b29989e2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a -F qcow2" returned: 0 in 0.356s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-7b164ddd-808a-4cc3-a16a-a3db3ffa892a" released by "_delete_snapshot" :: held 3.553s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" released by "delete_snapshot" :: held 3.579s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['28d9cd98-8982-4662-953a-672d1e2284d8', '1b6f3b6b-7a67-4e15-846d-dc2c7a4e6d3d', 'da0ba0c7-c2d2-4676-9289-ca8b5443d5d1', 'b911c6af-3f4f-4af7-9bcd-6f16fa63374e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Delete snapshot completed successfully. Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-7b164ddd-808a-4cc3-a16a-a3db3ffa892a-delete_snapshot" released by "delete_snapshot" :: held 3.844s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-9c0cb432-6522-4a37-b6d9-84acafb68c3a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-9c0cb432-6522-4a37-b6d9-84acafb68c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-9c0cb432-6522-4a37-b6d9-84acafb68c3a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-9c0cb432-6522-4a37-b6d9-84acafb68c3a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Deleting offline snapshot 9c0cb432-6522-4a37-b6d9-84acafb68c3a of volume ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] snapshot_file for this snap is: volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a61b0-1d3a-417a-b416-f3913046d0cc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:45 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:45 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab921be9-9978-45ca-b058-2b04b29989e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b5a36b-06a6-4048-87e6-99da364112a7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:46 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:46 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:46 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.472s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:46 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:46 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:47 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.442s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:47 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a Aug 11 06:38:47 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:47 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2.9c0cb432-6522-4a37-b6d9-84acafb68c3a" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-9c0cb432-6522-4a37-b6d9-84acafb68c3a" released by "_delete_snapshot" :: held 1.793s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" released by "delete_snapshot" :: held 1.817s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['e4016022-05a4-4c09-bf86-394aa5defc0c', '18104269-387f-4a23-a5a4-01440e7b7e81', '98008b6a-214f-436b-a624-4bf80686ef81', '05f263ad-2f14-42dd-8760-17e3a367a61b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:47 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Delete snapshot completed successfully. Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-9c0cb432-6522-4a37-b6d9-84acafb68c3a-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Snapshots deleted, issuing volume delete {{(pid=94463) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a2eae8-c614-4ef3-b5df-e2781b786c6a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:47 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:47 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:48 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:48 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2 Aug 11 06:38:48 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:48 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ab921be9-9978-45ca-b058-2b04b29989e2" returned: 0 in 0.272s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-ab921be9-9978-45ca-b058-2b04b29989e2" released by "delete_volume" :: held 0.891s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['1e7608f6-21e8-415f-a5e3-1dc1049b4a67', '47375826-0548-4df1-8984-a3d1a6bfc943', 'fcc0ecbd-ca51-4c48-a8a2-04d7c8a371c3', '2ca4cb4a-ae61-4818-b041-09af7f292ae5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:48 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:38:48 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:48 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.306s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:48 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:38:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Deleted volume successfully. Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e27f4a82-22e6-4a2e-810e-17a3b93f6412 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-ab921be9-9978-45ca-b058-2b04b29989e2-delete_volume" released by "delete_volume" :: held 7.541s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (22bb8468-93e1-41c8-80bd-2e9121c1b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf6916-373c-4134-89d0-f4011d39d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf6916-373c-4134-89d0-f4011d39d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-859255511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5f6aa8-3f54-4517-b76c-d47603177a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e545f2604a504bd8b2cec95e02372f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:50Z,use_quota=True,user_id='ec263ad3076e48188b396b5f20a87ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da96d2a-b7fe-4354-bc7e-23a81886828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da96d2a-b7fe-4354-bc7e-23a81886828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8217c02d-0625-4008-a3ce-1de22d2ddcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8217c02d-0625-4008-a3ce-1de22d2ddcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5f6aa8-3f54-4517-b76c-d47603177a3f', 'volume_name': 'volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aeccbb1-0ebc-4e75-80d4-c05311745124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aeccbb1-0ebc-4e75-80d4-c05311745124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8707d73-2557-4945-bd74-2b5617413c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Volume 3e5f6aa8-3f54-4517-b76c-d47603177a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f', 'volume_size': 1} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-859255511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5f6aa8-3f54-4517-b76c-d47603177a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e545f2604a504bd8b2cec95e02372f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:50Z,use_quota=True,user_id='ec263ad3076e48188b396b5f20a87ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Creating volume 3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:38:50 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:50 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f 1073741824 Aug 11 06:38:50 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-3cb253cf-b93c-4962-8b2e-ba0439856b84 req-a2033287-c6bd-4211-a650-daac34571fd0 tempest-TestShelveInstance-1534789965 None] Terminate volume connection completed successfully. Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-3cb253cf-b93c-4962-8b2e-ba0439856b84 req-a2033287-c6bd-4211-a650-daac34571fd0 tempest-TestShelveInstance-1534789965 None] Deleting attachment 7be6efc3-06f8-4f4c-8fb6-886e16637c94. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:38:50 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f 1073741824" returned: 0 in 0.730s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:50 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:38:50 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:51 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=83,cinder:UPDATE=75,cinder:INSERT=30,cinder:DELETE=7 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8707d73-2557-4945-bd74-2b5617413c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fd7f4-fca5-4cdc-b015-cf871e76e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=91,cinder:UPDATE=64,cinder:INSERT=29,cinder:DELETE=5 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:38:51 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Volume volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f (3e5f6aa8-3f54-4517-b76c-d47603177a3f): created successfully Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fd7f4-fca5-4cdc-b015-cf871e76e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (22bb8468-93e1-41c8-80bd-2e9121c1b581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ad87cd77-ba16-4f10-9d34-1871962a00f4 tempest-VolumesDeleteCascade-1698647485 None] Created volume successfully. Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Creating offline snapshot 130f03b6-1168-470d-bb60-bd9a20fc9c3a of volume 3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e424f-93ce-479f-b083-b731c874a7c3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Flow 'volume_create_manager' (5cd4b2db-1f7a-4e2c-8ceb-af314c8ceea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1986394-4934-44e0-9618-94bcee8e49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1986394-4934-44e0-9618-94bcee8e49d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-68387719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44dd3e15-5aba-4fbe-9145-f708d75f40f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40aa61c512f4555b42a038c36e5181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=264d66a3-0afc-48db-9f50-1a5d928a767b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:53Z,use_quota=True,user_id='eec75757a7774dcc9fb3b96e2a5d2262',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08316e8-ac2d-424c-91dc-0363f5d91fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08316e8-ac2d-424c-91dc-0363f5d91fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279988e8-c05f-4efc-94aa-04c96f0c9776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279988e8-c05f-4efc-94aa-04c96f0c9776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44dd3e15-5aba-4fbe-9145-f708d75f40f7', 'volume_name': 'volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7', 'volume_size': 1, 'snapshot_id': '264d66a3-0afc-48db-9f50-1a5d928a767b'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d0d56b-a5a2-4004-bda9-868e18c26b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d0d56b-a5a2-4004-bda9-868e18c26b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:52 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:38:52 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5875766f-1721-4e62-b908-cb5d16e628f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:52 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Volume 44dd3e15-5aba-4fbe-9145-f708d75f40f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7', 'volume_size': 1, 'snapshot_id': '264d66a3-0afc-48db-9f50-1a5d928a767b'} Aug 11 06:38:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:53 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:53 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a 1G Aug 11 06:38:53 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:54 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a 1G" returned: 0 in 0.803s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:54 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:38:54 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-fd42c00b-2101-486a-b82f-11feef578027 req-e2f79fe1-e9ba-41dc-9fda-da2d6fc7e0e3 tempest-TestShelveInstance-1534789965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:54 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 0.372s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:54 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a is being set with open permissions: ugo+rw Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:54 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:38:54 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:54 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:54 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info Aug 11 06:38:54 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:55 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:55 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info is being set with open permissions: ugo+rw Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:55 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info Aug 11 06:38:55 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:55 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.info" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.473s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b-44dd3e15-5aba-4fbe-9145-f708d75f40f7" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b-44dd3e15-5aba-4fbe-9145-f708d75f40f7" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Creating volume 44dd3e15-5aba-4fbe-9145-f708d75f40f7 from snapshot 264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:38:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7a7e8e45-9a51-48e9-903b-a9cb8dcf1868 tempest-VolumesDeleteCascade-1698647485 None] Create snapshot completed successfully Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] snapshot: 264d66a3-0afc-48db-9f50-1a5d928a767b, volume: 44dd3e15-5aba-4fbe-9145-f708d75f40f7, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964a772-42ec-4f8c-87a6-fc8461565b7b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:55 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:38:55 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:56 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.546s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be4184e-f903-4597-bbe7-b2b45613ad4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f5d8c-d1b0-4281-ad54-6dceabea59c5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:56 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:38:56 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:38:56 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (ca0a35a2-7b51-41aa-b71e-30ae144c542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97009d01-030f-41b9-b672-d6423d09b8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.687s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97009d01-030f-41b9-b672-d6423d09b8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2123978273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a279a318-c647-41ba-beb5-420c3d30287a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e545f2604a504bd8b2cec95e02372f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=130f03b6-1168-470d-bb60-bd9a20fc9c3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:38:57Z,use_quota=True,user_id='ec263ad3076e48188b396b5f20a87ef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d81672-ad27-44b8-8b05-f3c54df1c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:56 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 Aug 11 06:38:56 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d81672-ad27-44b8-8b05-f3c54df1c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50521bae-f29b-4130-aed5-6288ef8b2814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50521bae-f29b-4130-aed5-6288ef8b2814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a279a318-c647-41ba-beb5-420c3d30287a', 'volume_name': 'volume-a279a318-c647-41ba-beb5-420c3d30287a', 'volume_size': 1, 'snapshot_id': '130f03b6-1168-470d-bb60-bd9a20fc9c3a'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5fd680-e33b-40d7-b160-2f7acf525d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5fd680-e33b-40d7-b160-2f7acf525d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b68513-8dfd-440e-87e6-240a2f103fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:38:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Volume a279a318-c647-41ba-beb5-420c3d30287a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a279a318-c647-41ba-beb5-420c3d30287a', 'volume_size': 1, 'snapshot_id': '130f03b6-1168-470d-bb60-bd9a20fc9c3a'} Aug 11 06:38:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:02 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7" returned: 0 in 6.031s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:02 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:39:02 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Converted 1024.00 MB image at 169.75 MB/s Aug 11 06:39:02 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 is being set with open permissions: ugo+rw Aug 11 06:39:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:02 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 Aug 11 06:39:02 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:03 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7" returned: 0 in 0.309s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" released by "_copy_volume_from_snapshot" :: held 7.697s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b-44dd3e15-5aba-4fbe-9145-f708d75f40f7" released by "_create_volume_from_snapshot" :: held 7.779s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.810s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-fd42c00b-2101-486a-b82f-11feef578027 req-e2f79fe1-e9ba-41dc-9fda-da2d6fc7e0e3 tempest-TestShelveInstance-1534789965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.975s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-fd42c00b-2101-486a-b82f-11feef578027 req-e2f79fe1-e9ba-41dc-9fda-da2d6fc7e0e3 tempest-TestShelveInstance-1534789965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.342s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a-a279a318-c647-41ba-beb5-420c3d30287a" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5875766f-1721-4e62-b908-cb5d16e628f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7', 'volume_size': 1, 'snapshot_id': '264d66a3-0afc-48db-9f50-1a5d928a767b'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082cac4b-4967-4f2a-93e5-a5467974c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a-a279a318-c647-41ba-beb5-420c3d30287a" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Creating volume a279a318-c647-41ba-beb5-420c3d30287a from snapshot 130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] snapshot: 130f03b6-1168-470d-bb60-bd9a20fc9c3a, volume: a279a318-c647-41ba-beb5-420c3d30287a, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:39:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Volume volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 (44dd3e15-5aba-4fbe-9145-f708d75f40f7): created successfully Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082cac4b-4967-4f2a-93e5-a5467974c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Flow 'volume_create_manager' (5cd4b2db-1f7a-4e2c-8ceb-af314c8ceea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-fd42c00b-2101-486a-b82f-11feef578027 req-e2f79fe1-e9ba-41dc-9fda-da2d6fc7e0e3 tempest-TestShelveInstance-1534789965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-558c0133-3f90-4a21-9bab-4f37b0a132e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d6b4ff8-1fa6-4759-9d38-d0991bb2b6f9', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2004ba91-754a-4204-ad04-db334c8471d2 tempest-TestStampPattern-1257866422 None] Created volume successfully. Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f889afd-2669-423a-a6bc-513ba2248555]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-fd42c00b-2101-486a-b82f-11feef578027 req-e2f79fe1-e9ba-41dc-9fda-da2d6fc7e0e3 tempest-TestShelveInstance-1534789965 None] attachment_update completed successfully. Aug 11 06:39:03 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:39:03 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:03 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 0.563s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2ebf8-c62b-4746-aa4b-b70b77efa1f4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:04 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:39:04 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:04 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 0.583s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:39:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:39:04 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:39:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:04 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a Aug 11 06:39:04 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:12 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a" returned: 0 in 7.991s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:12 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f, size 1024.00 MB, duration 7.99 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:39:12 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Converted 1024.00 MB image at 128.12 MB/s Aug 11 06:39:12 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a is being set with open permissions: ugo+rw Aug 11 06:39:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:12 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a Aug 11 06:39:12 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:13 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a" returned: 0 in 0.536s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" released by "_copy_volume_from_snapshot" :: held 9.858s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a-a279a318-c647-41ba-beb5-420c3d30287a" released by "_create_volume_from_snapshot" :: held 10.002s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.040s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b68513-8dfd-440e-87e6-240a2f103fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a279a318-c647-41ba-beb5-420c3d30287a', 'volume_size': 1, 'snapshot_id': '130f03b6-1168-470d-bb60-bd9a20fc9c3a'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36627dd6-8182-4368-bda7-73daf13ba67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Volume volume-a279a318-c647-41ba-beb5-420c3d30287a (a279a318-c647-41ba-beb5-420c3d30287a): created successfully Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36627dd6-8182-4368-bda7-73daf13ba67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Flow 'volume_create_manager' (ca0a35a2-7b51-41aa-b71e-30ae144c542e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-496ae729-f9c8-4e09-9106-f3ce533fec71 tempest-VolumesDeleteCascade-1698647485 None] Created volume successfully. Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-3e5f6aa8-3f54-4517-b76c-d47603177a3f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-3e5f6aa8-3f54-4517-b76c-d47603177a3f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Performing cascade delete. {{(pid=94463) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 11 06:39:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-130f03b6-1168-470d-bb60-bd9a20fc9c3a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-130f03b6-1168-470d-bb60-bd9a20fc9c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Deleting offline snapshot 130f03b6-1168-470d-bb60-bd9a20fc9c3a of volume 3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] snapshot_file for this snap is: volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2173e07-c8c0-4c20-9a94-49ef374f7fbc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:14 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:39:14 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:15 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:39:15 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:15 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 1.117s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceef2e3-4c2f-411e-ab8e-67affcb60ea7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:15 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:39:15 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:15 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.629s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:39:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:39:16 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 1.045s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:16 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:39:16 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:17 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 0.533s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:17 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a Aug 11 06:39:17 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:17 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f.130f03b6-1168-470d-bb60-bd9a20fc9c3a" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-130f03b6-1168-470d-bb60-bd9a20fc9c3a" released by "_delete_snapshot" :: held 3.198s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" released by "delete_snapshot" :: held 3.255s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['82923f34-18d2-45d9-b5b1-b4ba7563ae71', '2cdfe202-b3cf-4820-a573-5743e81c12f3', '2f03d8fb-d26c-4496-af84-24f77cb6a928', '7db00b86-4103-4183-aab0-610081338080'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Delete snapshot completed successfully. Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-130f03b6-1168-470d-bb60-bd9a20fc9c3a-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Snapshots deleted, issuing volume delete {{(pid=94463) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd235159-0b92-416a-9f54-6a84af620163]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:17 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:39:17 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:18 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:18 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f Aug 11 06:39:18 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:18 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3e5f6aa8-3f54-4517-b76c-d47603177a3f" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-3e5f6aa8-3f54-4517-b76c-d47603177a3f" released by "delete_volume" :: held 1.057s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['07b3e559-97ef-4309-964f-d64fcf18bd64', '669f5c7c-a55d-48bd-bdc8-079d431d3b07', '2d6a741c-39c7-4d16-82d8-64d348b43459', '98da4ee8-1a44-4bbc-9aa2-bf427e777ea5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:18 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:39:18 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:19 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.308s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:39:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Deleted volume successfully. Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d933207d-e834-415f-864a-a4027527fe04 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-3e5f6aa8-3f54-4517-b76c-d47603177a3f-delete_volume" released by "delete_volume" :: held 5.221s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-a279a318-c647-41ba-beb5-420c3d30287a-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-a279a318-c647-41ba-beb5-420c3d30287a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" acquired by "delete_volume" :: waited 0.050s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d26b8-009a-401f-9936-73fe67fa19cb]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:20 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a Aug 11 06:39:20 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:20 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a" returned: 0 in 0.461s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:20 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a Aug 11 06:39:20 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:20 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a279a318-c647-41ba-beb5-420c3d30287a" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-quobyte-a279a318-c647-41ba-beb5-420c3d30287a" released by "delete_volume" :: held 0.782s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Created reservations ['a6670f60-7da2-4dca-a381-c412d64081b8', '6b89ce04-6a0a-4780-86d7-b42d83360bd7', 'dd8634a8-0d1e-40ae-ab65-d74869ef8a1a', 'a16caa6f-7d9b-4f0a-873b-218cb5565a0c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:21 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:39:21 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:21 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.287s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:21 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:39:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Deleted volume successfully. Aug 11 06:39:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f441f499-a096-43e8-8619-d4c9df08ea78 tempest-VolumesDeleteCascade-1698647485 None] Lock "cinder-a279a318-c647-41ba-beb5-420c3d30287a-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:30 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=33,cinder:DELETE=5,cinder:SELECT=30,cinder:INSERT=7 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:39:31 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=35,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:39:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ca9e43d2-0829-438e-9d7f-3fa20a346dc4 req-5f717999-fd02-420f-aebb-f44eaaa6d8b9 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ca9e43d2-0829-438e-9d7f-3fa20a346dc4 req-5f717999-fd02-420f-aebb-f44eaaa6d8b9 tempest-TestStampPattern-1257866422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-ca9e43d2-0829-438e-9d7f-3fa20a346dc4 req-5f717999-fd02-420f-aebb-f44eaaa6d8b9 tempest-TestStampPattern-1257866422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-ca9e43d2-0829-438e-9d7f-3fa20a346dc4 req-5f717999-fd02-420f-aebb-f44eaaa6d8b9 tempest-TestStampPattern-1257866422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cb9b2d4-30b7-4c74-b962-bc2c1e6f65aa', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:39:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-ca9e43d2-0829-438e-9d7f-3fa20a346dc4 req-5f717999-fd02-420f-aebb-f44eaaa6d8b9 tempest-TestStampPattern-1257866422 None] attachment_update completed successfully. Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Flow 'volume_create_manager' (bac85c1f-48fa-48db-97ff-984ca5f5579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f85043-a884-4bbc-9458-e15c006ee872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f85043-a884-4bbc-9458-e15c006ee872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-407322129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47df399-0dba-47b1-bc0a-753eb861842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5993f789bb3c4c24a39e3c9c9b33f0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:39:40Z,use_quota=True,user_id='56dcf0108d86469d8a7efa0d00eccd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c681312-aa9b-43ae-9a37-7369dd9a535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c681312-aa9b-43ae-9a37-7369dd9a535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b69ad-39cb-477a-b374-ab1deca5c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b69ad-39cb-477a-b374-ab1deca5c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47df399-0dba-47b1-bc0a-753eb861842e', 'volume_name': 'volume-d47df399-0dba-47b1-bc0a-753eb861842e', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7dfb39-68a5-4aaa-adfa-d3d2c3bcf317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7dfb39-68a5-4aaa-adfa-d3d2c3bcf317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1cb281b-99f4-402d-821e-146a58e31884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:40 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Volume d47df399-0dba-47b1-bc0a-753eb861842e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47df399-0dba-47b1-bc0a-753eb861842e', 'volume_size': 1} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-407322129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47df399-0dba-47b1-bc0a-753eb861842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5993f789bb3c4c24a39e3c9c9b33f0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:39:40Z,use_quota=True,user_id='56dcf0108d86469d8a7efa0d00eccd65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Creating volume d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:39:40 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:40 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e 1073741824 Aug 11 06:39:40 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:40 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e 1073741824" returned: 0 in 0.547s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:41 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:39:41 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:41 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.309s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1cb281b-99f4-402d-821e-146a58e31884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47df399-0dba-47b1-bc0a-753eb861842e', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96643505-e36f-4cd8-b604-5652d815293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Volume volume-d47df399-0dba-47b1-bc0a-753eb861842e (d47df399-0dba-47b1-bc0a-753eb861842e): created successfully Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96643505-e36f-4cd8-b604-5652d815293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Flow 'volume_create_manager' (bac85c1f-48fa-48db-97ff-984ca5f5579d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ffa8e42b-8563-4d68-86c3-5ac62e43476c tempest-VolumesActionsTest-1900954802 None] Created volume successfully. Aug 11 06:39:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-46c4ae53-cc54-4843-aedc-3f7e9387bba9 req-3f4ec1db-0779-40f0-be9a-91c62fcd2277 tempest-TestStampPattern-1257866422 None] Terminate volume connection completed successfully. Aug 11 06:39:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-46c4ae53-cc54-4843-aedc-3f7e9387bba9 req-3f4ec1db-0779-40f0-be9a-91c62fcd2277 tempest-TestStampPattern-1257866422 None] Deleting attachment 8cb9b2d4-30b7-4c74-b962-bc2c1e6f65aa. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-44dd3e15-5aba-4fbe-9145-f708d75f40f7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "cinder-44dd3e15-5aba-4fbe-9145-f708d75f40f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fff73c-20bf-43b2-b28c-6277b1c5b90c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:47 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 Aug 11 06:39:47 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:47 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7" returned: 0 in 0.418s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:47 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7 Aug 11 06:39:47 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:47 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44dd3e15-5aba-4fbe-9145-f708d75f40f7" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-44dd3e15-5aba-4fbe-9145-f708d75f40f7" released by "delete_volume" :: held 0.744s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Created reservations ['dece2920-effb-4343-826a-b4ae18aac000', '69815eff-a6f7-4cd5-9612-f002e0e8f92c', 'd1784b2b-d525-4c43-a067-03047ad47e35', 'b753c3d4-7cae-48d5-8e78-5372ed302720'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:47 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:39:47 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:48 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.283s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:39:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Deleted volume successfully. Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9ce6afc-b20a-42be-bbcb-1a2c055617f5 tempest-TestStampPattern-1257866422 None] Lock "cinder-44dd3e15-5aba-4fbe-9145-f708d75f40f7-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-264d66a3-0afc-48db-9f50-1a5d928a767b-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-264d66a3-0afc-48db-9f50-1a5d928a767b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Deleting offline snapshot 264d66a3-0afc-48db-9f50-1a5d928a767b of volume 1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] snapshot_file for this snap is: volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e06b120-dab7-4cd2-b143-e8984ab583dc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:48 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:39:48 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:49 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.724s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be4184e-f903-4597-bbe7-b2b45613ad4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:39:49 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f92596-7561-48e5-827e-802eea5babfc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:49 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:39:49 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:50 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.847s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:50 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:39:50 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:50 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:50 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b Aug 11 06:39:50 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:50 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c.264d66a3-0afc-48db-9f50-1a5d928a767b" returned: 0 in 0.334s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-264d66a3-0afc-48db-9f50-1a5d928a767b" released by "_delete_snapshot" :: held 2.502s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" released by "delete_snapshot" :: held 2.533s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:50 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Created reservations ['d55f464c-486d-4870-a8d1-bf198ed7aa21', '95b99041-573d-4bbf-944e-01895607c182', 'fc78bacd-566c-4397-b827-c79fc9cba0b2', 'c3cb92ed-cc62-4259-905e-a334e6c68cd6'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Delete snapshot completed successfully. Aug 11 06:39:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e7d44c7-49df-4df8-8363-53d40b4abf4e tempest-TestStampPattern-1257866422 None] Lock "cinder-264d66a3-0afc-48db-9f50-1a5d928a767b-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-768645e8-f43a-4d0c-ab1c-884c620bf3bb tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" by "attach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-768645e8-f43a-4d0c-ab1c-884c620bf3bb tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" acquired by "attach_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-768645e8-f43a-4d0c-ab1c-884c620bf3bb tempest-VolumesActionsTest-1900954802 None] Attaching volume d47df399-0dba-47b1-bc0a-753eb861842e to instance e024b401-c35d-4991-86b3-b4fb91e83550 at mountpoint /dev/vdb on host None. Aug 11 06:39:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-768645e8-f43a-4d0c-ab1c-884c620bf3bb tempest-VolumesActionsTest-1900954802 None] Attach volume completed successfully. Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-768645e8-f43a-4d0c-ab1c-884c620bf3bb tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" released by "attach_volume" :: held 0.159s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da4ffc53-199e-41cd-95b2-03c6d618958f tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" by "detach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da4ffc53-199e-41cd-95b2-03c6d618958f tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-da4ffc53-199e-41cd-95b2-03c6d618958f tempest-VolumesActionsTest-1900954802 None] Detaching volume d47df399-0dba-47b1-bc0a-753eb861842e from instance e024b401-c35d-4991-86b3-b4fb91e83550. Aug 11 06:39:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-da4ffc53-199e-41cd-95b2-03c6d618958f tempest-VolumesActionsTest-1900954802 None] Detach volume completed successfully. Aug 11 06:39:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da4ffc53-199e-41cd-95b2-03c6d618958f tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" released by "detach_volume" :: held 0.252s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-1be4184e-f903-4597-bbe7-b2b45613ad4c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "cinder-1be4184e-f903-4597-bbe7-b2b45613ad4c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (1ffbe8b0-4b60-4f45-8634-0a0714bdf3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6d800-c553-492f-aa13-a46347e608d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6d800-c553-492f-aa13-a46347e608d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2090262469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d2d6e1-c015-4890-b5e8-5d7b5f94af90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:39:56Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5d187-f576-43c4-be64-bfc9a38510a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e5d187-f576-43c4-be64-bfc9a38510a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e40c69c-d865-4cb1-9aed-dc64b5c5888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e40c69c-d865-4cb1-9aed-dc64b5c5888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d2d6e1-c015-4890-b5e8-5d7b5f94af90', 'volume_name': 'volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a90c00b-33d5-4aa9-baed-dad597def69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a90c00b-33d5-4aa9-baed-dad597def69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10277685-3518-46d1-88b9-eedcc6f099a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Volume 79d2d6e1-c015-4890-b5e8-5d7b5f94af90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90', 'volume_size': 1} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2090262469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d2d6e1-c015-4890-b5e8-5d7b5f94af90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:39:56Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Creating volume 79d2d6e1-c015-4890-b5e8-5d7b5f94af90 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:39:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:56 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 1073741824 Aug 11 06:39:56 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Acquiring lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" acquired by "delete_volume" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[494173bc-dbbe-4e60-ab49-cd34d887bce5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:57 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:39:57 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:57 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 1073741824" returned: 0 in 0.983s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:57 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 Aug 11 06:39:57 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:57 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.973s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:57 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c Aug 11 06:39:57 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:58 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1be4184e-f903-4597-bbe7-b2b45613ad4c" returned: 0 in 0.439s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:58 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "cinder-quobyte-1be4184e-f903-4597-bbe7-b2b45613ad4c" released by "delete_volume" :: held 1.568s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10277685-3518-46d1-88b9-eedcc6f099a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a233fe52-4110-498d-80ed-df1000a4647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:39:58 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Volume volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 (79d2d6e1-c015-4890-b5e8-5d7b5f94af90): created successfully Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a233fe52-4110-498d-80ed-df1000a4647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (1ffbe8b0-4b60-4f45-8634-0a0714bdf3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:39:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f47fcb61-c69a-4066-b666-3e4dac30f767 tempest-AttachVolumeTestJSON-2076597861 None] Created volume successfully. Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Created reservations ['439ef3c4-9a3f-44bc-b50f-989fc607f7f8', '8847bcd7-c49f-4ce4-8d64-6e48997c31ff', 'c543d721-009b-4717-bac2-70821fcd1393', '67dc1df5-20d6-4d29-8246-59725c5208df'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:39:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:58 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:39:58 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:39:58 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.325s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:39:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Deleted volume successfully. Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b0a744c7-78d4-4980-9faa-8a9ec765465d tempest-TestStampPattern-1257866422 None] Lock "cinder-1be4184e-f903-4597-bbe7-b2b45613ad4c-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:39:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-c82050ff-676f-49e5-8218-398208085545 req-2c7ea476-03d4-41bf-b8a9-47721eeb808c tempest-TestShelveInstance-1534789965 None] Terminate volume connection completed successfully. Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-c82050ff-676f-49e5-8218-398208085545 req-2c7ea476-03d4-41bf-b8a9-47721eeb808c tempest-TestShelveInstance-1534789965 None] Deleting attachment 0d6b4ff8-1fa6-4759-9d38-d0991bb2b6f9. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Acquiring lock "cinder-558c0133-3f90-4a21-9bab-4f37b0a132e7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "cinder-558c0133-3f90-4a21-9bab-4f37b0a132e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Acquiring lock "cinder-quobyte-558c0133-3f90-4a21-9bab-4f37b0a132e7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "cinder-quobyte-558c0133-3f90-4a21-9bab-4f37b0a132e7" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a0748-87c6-4f52-b5d6-d39935ab10a0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:39:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:39:59 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 Aug 11 06:39:59 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:00 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7" returned: 0 in 0.630s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:00 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7 Aug 11 06:40:00 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:00 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-558c0133-3f90-4a21-9bab-4f37b0a132e7" returned: 0 in 0.412s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "cinder-quobyte-558c0133-3f90-4a21-9bab-4f37b0a132e7" released by "delete_volume" :: held 1.141s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8b6e2027-3271-4c21-9d3d-3258cbb9cb64 req-0d77b31d-08d4-41bd-aaa9-94a050c1c780 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8b6e2027-3271-4c21-9d3d-3258cbb9cb64 req-0d77b31d-08d4-41bd-aaa9-94a050c1c780 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-8b6e2027-3271-4c21-9d3d-3258cbb9cb64 req-0d77b31d-08d4-41bd-aaa9-94a050c1c780 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG cinder.quota [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Created reservations ['301adbb2-d29d-4801-b417-2121d2ef676a', '09ff2392-d5cf-4b55-85ce-cb1468f8d914', 'bff254ba-6710-41f4-9259-d818b7d2b5db', '1cc217f4-1caa-41a1-9674-21add389f917'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:40:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-8b6e2027-3271-4c21-9d3d-3258cbb9cb64 req-0d77b31d-08d4-41bd-aaa9-94a050c1c780 tempest-AttachVolumeTestJSON-2076597861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef9c12aa-0abd-46c7-a3d0-258c011ded26', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:40:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-8b6e2027-3271-4c21-9d3d-3258cbb9cb64 req-0d77b31d-08d4-41bd-aaa9-94a050c1c780 tempest-AttachVolumeTestJSON-2076597861 None] attachment_update completed successfully. Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:01 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:40:01 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:01 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.501s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG cinder.manager [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:40:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Deleted volume successfully. Aug 11 06:40:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [req-c82050ff-676f-49e5-8218-398208085545 req-305f6a6d-3ca5-4a26-abf0-29d84f2b40b9 tempest-TestShelveInstance-1534789965 None] Lock "cinder-558c0133-3f90-4a21-9bab-4f37b0a132e7-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (38f5d9f7-0d68-477f-951b-5f50d0f700a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479b51e9-af56-423a-afed-68bb83442654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479b51e9-af56-423a-afed-68bb83442654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1392289193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab026bd-d547-4665-ba42-d2cbc8e1db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:04Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b4d3f9-d78b-4390-8054-143ada10652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b4d3f9-d78b-4390-8054-143ada10652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f3d52-8e09-4b5d-89ff-2c3d7252513d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee4f3d52-8e09-4b5d-89ff-2c3d7252513d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab026bd-d547-4665-ba42-d2cbc8e1db88', 'volume_name': 'volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4112695-b216-44b4-9d48-fc88de453e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4112695-b216-44b4-9d48-fc88de453e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3e55c-5a44-4e63-9259-8a1c1cb3c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Volume 3ab026bd-d547-4665-ba42-d2cbc8e1db88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88', 'volume_size': 1} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1392289193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab026bd-d547-4665-ba42-d2cbc8e1db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fc307bc7844f1a7a027a50b2fb5d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:04Z,use_quota=True,user_id='a270689ada864be5815adba6457e2493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Creating volume 3ab026bd-d547-4665-ba42-d2cbc8e1db88 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:40:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:40:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:03 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 1073741824 Aug 11 06:40:03 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:04 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 1073741824" returned: 0 in 0.607s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:04 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 Aug 11 06:40:04 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:04 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88" returned: 0 in 0.263s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3e55c-5a44-4e63-9259-8a1c1cb3c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707e62b4-fc68-4a55-b279-ea53eb5ef1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Volume volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 (3ab026bd-d547-4665-ba42-d2cbc8e1db88): created successfully Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707e62b4-fc68-4a55-b279-ea53eb5ef1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Flow 'volume_create_manager' (38f5d9f7-0d68-477f-951b-5f50d0f700a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3ec57482-b359-43cd-8f1f-70549f44863d tempest-AttachVolumeTestJSON-2076597861 None] Created volume successfully. Aug 11 06:40:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e9baf0f4-f840-4757-b00d-b4328a1385db req-0bd71e53-17ce-4d47-ac34-4de093552a6f tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e9baf0f4-f840-4757-b00d-b4328a1385db req-0bd71e53-17ce-4d47-ac34-4de093552a6f tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-e9baf0f4-f840-4757-b00d-b4328a1385db req-0bd71e53-17ce-4d47-ac34-4de093552a6f tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-e9baf0f4-f840-4757-b00d-b4328a1385db req-0bd71e53-17ce-4d47-ac34-4de093552a6f tempest-AttachVolumeTestJSON-2076597861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51efef02-151e-41a0-adc9-4cd08bca3808', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:40:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-e9baf0f4-f840-4757-b00d-b4328a1385db req-0bd71e53-17ce-4d47-ac34-4de093552a6f tempest-AttachVolumeTestJSON-2076597861 None] attachment_update completed successfully. Aug 11 06:40:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-f52540ec-98fd-40d9-9322-7d718740bf42 req-9cb64264-1d4b-41bf-b515-bbbd16195715 tempest-AttachVolumeTestJSON-2076597861 None] Terminate volume connection completed successfully. Aug 11 06:40:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-f52540ec-98fd-40d9-9322-7d718740bf42 req-9cb64264-1d4b-41bf-b515-bbbd16195715 tempest-AttachVolumeTestJSON-2076597861 None] Deleting attachment ef9c12aa-0abd-46c7-a3d0-258c011ded26. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:40:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-ebe9a597-f27c-4315-85b8-06a7abf71127 req-0d403866-8cbf-4ab4-bb06-9aeff321788f tempest-AttachVolumeTestJSON-2076597861 None] Terminate volume connection completed successfully. Aug 11 06:40:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-ebe9a597-f27c-4315-85b8-06a7abf71127 req-0d403866-8cbf-4ab4-bb06-9aeff321788f tempest-AttachVolumeTestJSON-2076597861 None] Deleting attachment 51efef02-151e-41a0-adc9-4cd08bca3808. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:15 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:40:15 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:15 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.367s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:40:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-607e128d-251b-4c69-bd35-395607956137 tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" by "attach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-607e128d-251b-4c69-bd35-395607956137 tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" acquired by "attach_volume" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-607e128d-251b-4c69-bd35-395607956137 tempest-VolumesActionsTest-1900954802 None] Attaching volume d47df399-0dba-47b1-bc0a-753eb861842e to instance 77907eb9-ab52-4f39-9517-7ab4bd3df681 at mountpoint /dev/vdb on host None. Aug 11 06:40:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-607e128d-251b-4c69-bd35-395607956137 tempest-VolumesActionsTest-1900954802 None] Attach volume completed successfully. Aug 11 06:40:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-607e128d-251b-4c69-bd35-395607956137 tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e" released by "attach_volume" :: held 0.201s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca38f1ef-90a4-474e-a148-4bc9325cecba tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" by "detach_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca38f1ef-90a4-474e-a148-4bc9325cecba tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ca38f1ef-90a4-474e-a148-4bc9325cecba tempest-VolumesActionsTest-1900954802 None] Detaching volume d47df399-0dba-47b1-bc0a-753eb861842e from instance 77907eb9-ab52-4f39-9517-7ab4bd3df681. Aug 11 06:40:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ca38f1ef-90a4-474e-a148-4bc9325cecba tempest-VolumesActionsTest-1900954802 None] Detach volume completed successfully. Aug 11 06:40:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ca38f1ef-90a4-474e-a148-4bc9325cecba tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-detach_volume" released by "detach_volume" :: held 0.257s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-3ab026bd-d547-4665-ba42-d2cbc8e1db88-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-3ab026bd-d547-4665-ba42-d2cbc8e1db88-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-quobyte-3ab026bd-d547-4665-ba42-d2cbc8e1db88" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-3ab026bd-d547-4665-ba42-d2cbc8e1db88" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bee1a4f-02eb-4df5-9859-1c3471d1913f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:20 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 Aug 11 06:40:20 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:20 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88" returned: 0 in 0.420s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:20 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88 Aug 11 06:40:20 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:20 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3ab026bd-d547-4665-ba42-d2cbc8e1db88" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-3ab026bd-d547-4665-ba42-d2cbc8e1db88" released by "delete_volume" :: held 0.791s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Created reservations ['38ee0b86-a9bc-431b-a825-ba9396bf9fed', 'c101ee3f-4687-4a0e-bb20-a7fe219d290b', '6cc3b34b-f4a3-49e9-8bb0-a4c3bd188458', '89bdd46e-beb9-4e81-8ef0-43038271fd0a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:21 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:40:21 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-79d2d6e1-c015-4890-b5e8-5d7b5f94af90-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:21 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:40:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Deleted volume successfully. Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-79d2d6e1-c015-4890-b5e8-5d7b5f94af90-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0602af11-0659-4ffc-9110-c62daae29252 tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-3ab026bd-d547-4665-ba42-d2cbc8e1db88-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-quobyte-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab6b91-6dad-492a-97bc-55ccfd796bbd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:21 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 Aug 11 06:40:21 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Flow 'volume_create_manager' (77dfbf90-33bd-4727-b6d1-dcbf606050cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19372e15-1886-4ec9-a7ac-c76204edcd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19372e15-1886-4ec9-a7ac-c76204edcd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769429475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7559ae9-5ab1-4f23-bf26-f4207739881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212781e541b405abf122b1cae1a80c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:22Z,use_quota=True,user_id='3bed12d99cf1416fb368a64e0f717c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf07a15-9ae6-491d-a1c8-fab3e95f91fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf07a15-9ae6-491d-a1c8-fab3e95f91fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c4869e-57d6-4b0f-a5ed-959aed82179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c4869e-57d6-4b0f-a5ed-959aed82179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7559ae9-5ab1-4f23-bf26-f4207739881a', 'volume_name': 'volume-f7559ae9-5ab1-4f23-bf26-f4207739881a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7775b8-7b54-4ac0-94bc-62c057fe7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7775b8-7b54-4ac0-94bc-62c057fe7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:21 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ae43b-a99a-45db-8fa7-ab27c2c8d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:21 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Volume f7559ae9-5ab1-4f23-bf26-f4207739881a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7559ae9-5ab1-4f23-bf26-f4207739881a', 'volume_size': 1} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769429475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7559ae9-5ab1-4f23-bf26-f4207739881a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212781e541b405abf122b1cae1a80c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:22Z,use_quota=True,user_id='3bed12d99cf1416fb368a64e0f717c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Creating volume f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:40:21 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:21 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a 1073741824 Aug 11 06:40:21 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:21 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90 Aug 11 06:40:21 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:22 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-79d2d6e1-c015-4890-b5e8-5d7b5f94af90" released by "delete_volume" :: held 0.886s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Created reservations ['b8a9c7da-499c-40ff-88b3-dd962efabee7', '0c6bdbcb-ba72-4ae9-a8d4-54e5144f4981', '84395a9c-aa71-4a1a-8177-80461bf7d5e8', '7855a173-4740-4b88-95c4-f2ebffcf0b99'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:22 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:40:22 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:22 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a 1073741824" returned: 0 in 0.664s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-27ff7019-5785-486b-98c2-a395de766fad-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:22 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:40:22 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-27ff7019-5785-486b-98c2-a395de766fad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "cinder-quobyte-27ff7019-5785-486b-98c2-a395de766fad" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-27ff7019-5785-486b-98c2-a395de766fad" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:40:22 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.347s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:40:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Deleted volume successfully. Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa3c75-e3f0-47e2-a2d4-8d4828f67c5b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d9f927f-c67e-41e9-831f-faad1e0985ea tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-79d2d6e1-c015-4890-b5e8-5d7b5f94af90-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:23 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad Aug 11 06:40:23 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:23 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.418s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2ae43b-a99a-45db-8fa7-ab27c2c8d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7559ae9-5ab1-4f23-bf26-f4207739881a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2421b1bc-3f8d-45bd-81a4-0204a6ea3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Volume volume-f7559ae9-5ab1-4f23-bf26-f4207739881a (f7559ae9-5ab1-4f23-bf26-f4207739881a): created successfully Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2421b1bc-3f8d-45bd-81a4-0204a6ea3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Flow 'volume_create_manager' (77dfbf90-33bd-4727-b6d1-dcbf606050cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8eb0c4af-b1b0-4599-a5c5-4ef2f371b981 tempest-VolumeDependencyTests-399219883 None] Created volume successfully. Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43a5c9-755d-47f5-8e11-30e830dfadf0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:23 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad" returned: 0 in 0.439s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:23 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad Aug 11 06:40:23 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:23 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:40:23 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:23 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-27ff7019-5785-486b-98c2-a395de766fad" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-quobyte-27ff7019-5785-486b-98c2-a395de766fad" released by "delete_volume" :: held 0.789s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Created reservations ['e6ad3f95-5ecd-41f0-a02c-cf6afbed37fd', '7a2881cb-b9f7-4e28-8431-880ba32bc991', '6501b765-f506-49f7-a699-39d89c8cb805', '2babfe01-cea5-4812-b07a-dafc2b325554'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:40:23 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.406s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7fda3c-fdc2-47ac-b4aa-06b49876e108]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:23 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:40:23 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:23 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:40:23 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:24 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.350s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:40:24 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Deleted volume successfully. Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b5407094-b6c7-404c-84c0-d90c7117f81a tempest-AttachVolumeTestJSON-2076597861 None] Lock "cinder-27ff7019-5785-486b-98c2-a395de766fad-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:40:24 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.542s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.a03ebd15-fde0-46d8-8a4d-a957c4fd3e1fo64hjzb3.img {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:24 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.a03ebd15-fde0-46d8-8a4d-a957c4fd3e1fo64hjzb3.img Aug 11 06:40:24 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Flow 'volume_create_manager' (9cb9f0e8-7579-44ab-a018-50e6748fbf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32b477e-bb7e-4a0a-85b0-26257e203f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32b477e-bb7e-4a0a-85b0-26257e203f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cf8fe2-85f9-48aa-a45e-2a0ea54fa174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d64721efca34160ae587b44e34fa234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:26Z,use_quota=True,user_id='5aa75de96f7b400c87cc73b190767d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a16d122d-490a-43de-87dd-8c6746dcb046),volume_type_id=a16d122d-490a-43de-87dd-8c6746dcb046)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9c7b4f-313e-4b0c-83ef-fff4ffc71456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9c7b4f-313e-4b0c-83ef-fff4ffc71456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc0f3d0-1497-4f17-ba46-4697362a9cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:25 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc0f3d0-1497-4f17-ba46-4697362a9cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15cf8fe2-85f9-48aa-a45e-2a0ea54fa174', 'volume_name': 'volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174', 'volume_size': 1, 'image_id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ad01ca5c9c54e9a7698208dda617540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d64721efca34160ae587b44e34fa234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac35dd7c56d4ed1850e27428ac05c4b85f4eed3d8d04b7d5295fb4061fb47beef241dea5b00df0b3af7f84cfab5c18f74f88477aa319bec5bcad34589cd8c80d', 'id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'created_at': datetime.datetime(2026, 8, 11, 4, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5e9df-b389-4411-a85c-b9bd5006af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b5e9df-b389-4411-a85c-b9bd5006af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3af313-d103-4901-8f46-879df75decd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174', 'volume_size': 1, 'image_id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ad01ca5c9c54e9a7698208dda617540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d64721efca34160ae587b44e34fa234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac35dd7c56d4ed1850e27428ac05c4b85f4eed3d8d04b7d5295fb4061fb47beef241dea5b00df0b3af7f84cfab5c18f74f88477aa319bec5bcad34589cd8c80d', 'id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'created_at': datetime.datetime(2026, 8, 11, 4, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Trying to clone 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 from image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:40:26 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Image download 0.00 MB at 0.00 MB/s Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fc45a1-a34f-4fde-9a4c-9336980ee7a8]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:27 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:27 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:27 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:27 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:27 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:28 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 1 in 0.900s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:40:28 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Temporary image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 is fetched for user 5aa75de96f7b400c87cc73b190767d43. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:40:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a439c-62d4-405a-a519-01d698bfe10e]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:28 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:28 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:29 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:29 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.a03ebd15-fde0-46d8-8a4d-a957c4fd3e1fo64hjzb3.img" returned: 0 in 5.153s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a9b6a0-4650-4b90-8027-a6638a368e02]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:29 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:29 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:29 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:40:29 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:29 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:40:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:30 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.610s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:30 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.a03ebd15-fde0-46d8-8a4d-a957c4fd3e1fo64hjzb3.img {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:40:30 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Converted 1024.00 MB image at 198.66 MB/s Aug 11 06:40:30 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] a03ebd15-fde0-46d8-8a4d-a957c4fd3e1f was raw, no need to convert to raw {{(pid=94463) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 11 06:40:38 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=91,cinder:UPDATE=74,cinder:DELETE=4,cinder:INSERT=17 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:40:40 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=78,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=6 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.040s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Uploaded volume to glance image-id: a03ebd15-fde0-46d8-8a4d-a957c4fd3e1f. {{(pid=94463) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 27.039s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Creating offline snapshot 5de908f1-cd20-4d6d-9ba1-76fbecc22e0e of volume f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:40:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-daadf3ff-df8c-4e91-958c-d349178d02ce tempest-VolumesActionsTest-1900954802 None] Copy volume to image completed successfully. Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae5ca2f-bb3a-4e1c-bea8-3f5bf481f59f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:51 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:40:51 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:51 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:51 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e 1G Aug 11 06:40:51 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:52 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e 1G" returned: 0 in 0.586s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7559ae9-5ab1-4f23-bf26-f4207739881a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:52 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7559ae9-5ab1-4f23-bf26-f4207739881a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:40:52 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:52 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7559ae9-5ab1-4f23-bf26-f4207739881a -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:52 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e is being set with open permissions: ugo+rw Aug 11 06:40:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:52 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:40:52 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:53 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:53 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info Aug 11 06:40:53 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:53 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info" returned: 0 in 0.337s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:53 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info is being set with open permissions: ugo+rw Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:53 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info Aug 11 06:40:53 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:53 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.info" returned: 0 in 0.253s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.485s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.984s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cf8fe2-85f9-48aa-a45e-2a0ea54fa174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d64721efca34160ae587b44e34fa234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:26Z,use_quota=True,user_id='5aa75de96f7b400c87cc73b190767d43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a16d122d-490a-43de-87dd-8c6746dcb046),volume_type_id=a16d122d-490a-43de-87dd-8c6746dcb046)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Creating volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:40:53 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:40:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:53 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1073741824 Aug 11 06:40:53 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e76576ff-5b33-4f09-83a9-21e6d93fa0fb tempest-VolumeDependencyTests-399219883 None] Create snapshot completed successfully Aug 11 06:40:54 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1073741824" returned: 0 in 0.453s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:54 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 Aug 11 06:40:54 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:54 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" returned: 0 in 0.302s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.699s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17569046-1dc4-4148-8962-11519ec15558]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Attempting download of 1d11dfc9-decc-4ace-a8d3-0046a668ada2 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}])) to volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8f556-0f9c-4fc2-8655-df309921672d]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:54 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:40:54 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:54 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez Aug 11 06:40:54 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5fe782-1c7e-4ee9-8cb1-7f5b46f72aa4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:55 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:55 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez" returned: 0 in 0.475s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:55 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:40:55 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:55 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez Aug 11 06:40:55 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:55 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez" returned: 1 in 0.732s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1d11dfc9-decc-4ace-a8d3-0046a668ada2_l2ts1cez' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[32502420-175b-44ee-970d-4842c010cbba]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:40:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:40:56 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.908s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:56 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:56 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:56 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img Aug 11 06:40:56 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Flow 'volume_create_manager' (8dc403ab-608e-4b77-9201-ae2955626c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38a85c5-6f89-40f5-ac7a-ac6960d12275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38a85c5-6f89-40f5-ac7a-ac6960d12275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1690444084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3970c527-8157-4234-a81b-2dbc0f1050cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1212781e541b405abf122b1cae1a80c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5de908f1-cd20-4d6d-9ba1-76fbecc22e0e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:40:56Z,use_quota=True,user_id='3bed12d99cf1416fb368a64e0f717c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9262045c-c0ef-4705-8b99-6b7a13b8c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9262045c-c0ef-4705-8b99-6b7a13b8c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe86c39-52a6-4b93-a83b-e86f5f590cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe86c39-52a6-4b93-a83b-e86f5f590cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3970c527-8157-4234-a81b-2dbc0f1050cb', 'volume_name': 'volume-3970c527-8157-4234-a81b-2dbc0f1050cb', 'volume_size': 1, 'snapshot_id': '5de908f1-cd20-4d6d-9ba1-76fbecc22e0e'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2e13c3-3a52-47bb-80f3-b217be6c2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2e13c3-3a52-47bb-80f3-b217be6c2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628922a7-563d-418f-8d5e-5ad421c074ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:40:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Volume 3970c527-8157-4234-a81b-2dbc0f1050cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3970c527-8157-4234-a81b-2dbc0f1050cb', 'volume_size': 1, 'snapshot_id': '5de908f1-cd20-4d6d-9ba1-76fbecc22e0e'} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:40:56 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:56 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD Aug 11 06:40:56 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:57 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD" returned: 1 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:40:57 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] 1d11dfc9-decc-4ace-a8d3-0046a668ada2 was raw, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:40:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:57 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 Aug 11 06:40:57 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:58 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" returned: 0 in 1.535s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1d11dfc9-decc-4ace-a8d3-0046a668ada2_tqe_eorgdevstack@QuobyteHD, size 0.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:40:58 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 06:40:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:40:58 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1G Aug 11 06:40:58 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:40:59 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 1G" returned: 0 in 1.033s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Downloaded image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 ((None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}])) to volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Temporary image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 for user 5aa75de96f7b400c87cc73b190767d43 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Marking volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Copying metadata from image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 to 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:40:59 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Creating volume glance metadata for volume 15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 backed by image 1d11dfc9-decc-4ace-a8d3-0046a668ada2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2ad01ca5c9c54e9a7698208dda617540', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:41:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3af313-d103-4901-8f46-879df75decd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174', 'volume_size': 1, 'image_id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ad01ca5c9c54e9a7698208dda617540', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d64721efca34160ae587b44e34fa234', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ac35dd7c56d4ed1850e27428ac05c4b85f4eed3d8d04b7d5295fb4061fb47beef241dea5b00df0b3af7f84cfab5c18f74f88477aa319bec5bcad34589cd8c80d', 'id': '1d11dfc9-decc-4ace-a8d3-0046a668ada2', 'created_at': datetime.datetime(2026, 8, 11, 4, 40, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 40, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1d11dfc9-decc-4ace-a8d3-0046a668ada2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ad9531-9787-43c0-9531-f8d44ef4e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Volume volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 (15cf8fe2-85f9-48aa-a45e-2a0ea54fa174): created successfully Aug 11 06:41:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ad9531-9787-43c0-9531-f8d44ef4e656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Flow 'volume_create_manager' (9cb9f0e8-7579-44ab-a018-50e6748fbf75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c6bab62d-a5b2-490a-83a9-ed347541e834 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Created volume successfully. Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Acquiring lock "cinder-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "cinder-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Acquiring lock "cinder-quobyte-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "cinder-quobyte-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" acquired by "delete_volume" :: waited 0.047s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3cd13-37bb-4113-8fb5-fcb857112cbc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:01 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 Aug 11 06:41:01 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:02 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" returned: 0 in 1.186s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:02 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174 Aug 11 06:41:02 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:02 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img" returned: 0 in 6.759s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5690dc3-0e8c-4330-8359-392f4b0d47e9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:03 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:41:03 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:03 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "cinder-quobyte-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174" released by "delete_volume" :: held 1.787s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:03 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:41:03 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Created reservations ['202ad66e-6cc4-4f5c-bc56-8121c1a09bfa', '0eee4f28-e02c-406c-9878-29afe359fb69', 'a929ddf9-ef20-4b79-b8b1-d411bc3c4b0b', 'd4fa0257-4dbf-4d20-9dab-47c6f2c259b3'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:03 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:03 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:03 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 0.695s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:41:03 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Converted 1024.00 MB image at 151.48 MB/s Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] ca335e36-e9d9-4980-beec-667fb99daf43 was raw, converting to qcow2 {{(pid=94463) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c007df-e500-48af-99c9-5802d897bfca]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:03 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Deleted volume successfully. Aug 11 06:41:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1eb7d253-8cee-45d5-96c2-c9e670ac6f65 tempest-VolumeAndVolumeTypeFromImageTest-1876331303 None] Lock "cinder-15cf8fe2-85f9-48aa-a45e-2a0ea54fa174-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:03 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img Aug 11 06:41:03 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:04 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img" returned: 0 in 0.559s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:04 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img Aug 11 06:41:04 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:04 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img" returned: 1 in 0.459s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img /opt/stack/data/cinder/conversion/vol_upload_hivig1fz {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:04 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img /opt/stack/data/cinder/conversion/vol_upload_hivig1fz Aug 11 06:41:04 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:04 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img /opt/stack/data/cinder/conversion/vol_upload_hivig1fz" returned: 0 in 0.338s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Image conversion details: src /opt/stack/data/cinder/conversion/d47df399-0dba-47b1-bc0a-753eb861842e.temp_image.ca335e36-e9d9-4980-beec-667fb99daf43j1yer515.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hivig1fz {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:41:04 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[47335f02-2e1b-4d24-a0f9-ed4d25d1a4fd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hivig1fz {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:05 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hivig1fz Aug 11 06:41:05 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:05 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hivig1fz" returned: 0 in 0.471s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.692s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Uploaded volume to glance image-id: ca335e36-e9d9-4980-beec-667fb99daf43. {{(pid=94463) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.900s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-3970c527-8157-4234-a81b-2dbc0f1050cb" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-3970c527-8157-4234-a81b-2dbc0f1050cb" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Creating volume 3970c527-8157-4234-a81b-2dbc0f1050cb from snapshot 5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b74830ca-485d-4cb6-8fb8-f583756259f5 tempest-VolumesActionsTest-1900954802 None] Copy volume to image completed successfully. Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] snapshot: 5de908f1-cd20-4d6d-9ba1-76fbecc22e0e, volume: 3970c527-8157-4234-a81b-2dbc0f1050cb, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5339b007-340a-4893-97c8-52277362242f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:07 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:41:07 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:07 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.361s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7559ae9-5ab1-4f23-bf26-f4207739881a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52048f4-3dc7-45ea-9540-a5853278d476]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:07 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:41:07 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:08 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:41:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:41:08 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:41:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:08 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb Aug 11 06:41:08 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Acquiring lock "cinder-quobyte-d47df399-0dba-47b1-bc0a-753eb861842e" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "cinder-quobyte-d47df399-0dba-47b1-bc0a-753eb861842e" acquired by "delete_volume" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a36e01-b102-4ba2-9d0b-55d563fdd8aa]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:10 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:41:10 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:11 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 1.188s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:11 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e Aug 11 06:41:11 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:12 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d47df399-0dba-47b1-bc0a-753eb861842e" returned: 0 in 1.172s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "cinder-quobyte-d47df399-0dba-47b1-bc0a-753eb861842e" released by "delete_volume" :: held 2.449s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Created reservations ['64c58643-a520-4a1a-be5f-814fcdfcc304', 'e211ac28-aca8-4e1e-9ebc-352fbcb780fe', 'd31328e2-2630-47f3-9784-a876ba2de261', 'c155211d-0dd2-4b6a-86ab-b08d41ded11e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:13 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:13 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:13 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.512s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Deleted volume successfully. Aug 11 06:41:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6cecdf83-531f-4222-9095-80c5668bf1bf tempest-VolumesActionsTest-1900954802 None] Lock "cinder-d47df399-0dba-47b1-bc0a-753eb861842e-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:15 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:15 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:15 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb" returned: 0 in 6.847s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:41:15 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Converted 1024.00 MB image at 149.54 MB/s Aug 11 06:41:15 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb is being set with open permissions: ugo+rw Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:15 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb Aug 11 06:41:15 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:15 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.307s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:41:15 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-3970c527-8157-4234-a81b-2dbc0f1050cb" released by "_create_volume_from_snapshot" :: held 8.141s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.179s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628922a7-563d-418f-8d5e-5ad421c074ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3970c527-8157-4234-a81b-2dbc0f1050cb', 'volume_size': 1, 'snapshot_id': '5de908f1-cd20-4d6d-9ba1-76fbecc22e0e'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fc3012-f234-4eae-8817-0f582fa58ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:15 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Volume volume-3970c527-8157-4234-a81b-2dbc0f1050cb (3970c527-8157-4234-a81b-2dbc0f1050cb): created successfully Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fc3012-f234-4eae-8817-0f582fa58ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Flow 'volume_create_manager' (8dc403ab-608e-4b77-9201-ae2955626c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-24bc80c1-ac1d-4e3d-9f0c-cba9e88ee3d4 tempest-VolumeDependencyTests-399219883 None] Created volume successfully. Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Deleting offline snapshot 5de908f1-cd20-4d6d-9ba1-76fbecc22e0e of volume f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] snapshot_file for this snap is: volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd98f68d-812b-4f2c-b299-4eae465626f5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:15 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:41:15 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:16 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.407s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7559ae9-5ab1-4f23-bf26-f4207739881a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e08a01-4eed-4333-b666-104d06e106b1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:16 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:41:16 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Flow 'volume_create_manager' (da9830b4-b05f-4f54-8549-692c22e833f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23d8b8c-081c-4e12-9311-ddfc288955a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23d8b8c-081c-4e12-9311-ddfc288955a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f598cc8-8afc-4c0f-8707-084242bf5f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47fcccff771d456785c6fc54b9e95b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:17Z,use_quota=True,user_id='94a116fc414c42e8b410f87314da75ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838f5289-f420-4280-98c4-f8b5965d3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838f5289-f420-4280-98c4-f8b5965d3275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81763ec2-da20-4225-b7cc-cfc816f7b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:41:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.671s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81763ec2-da20-4225-b7cc-cfc816f7b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f598cc8-8afc-4c0f-8707-084242bf5f9b', 'volume_name': 'volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b', 'volume_size': 1, 'image_id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0eab0d1bde69bc9afd2b7703e4ec2469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47fcccff771d456785c6fc54b9e95b25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d89a37bf11037607d4aebe97ac34c179f3bd5650a5b46cd38cbe0dcd65b3feff1749b0cfb8f0f9b1df45d0be5c2f45068b323c0498aafcb2c09cd65c8c2a5', 'id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'created_at': datetime.datetime(2026, 8, 11, 4, 41, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 41, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a7b940-3bd2-4dd3-9965-1c91c2e88d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:16 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a7b940-3bd2-4dd3-9965-1c91c2e88d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:16 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf983aa8-4267-4f2f-a6c7-be3af8e4afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:16 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b', 'volume_size': 1, 'image_id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0eab0d1bde69bc9afd2b7703e4ec2469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47fcccff771d456785c6fc54b9e95b25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d89a37bf11037607d4aebe97ac34c179f3bd5650a5b46cd38cbe0dcd65b3feff1749b0cfb8f0f9b1df45d0be5c2f45068b323c0498aafcb2c09cd65c8c2a5', 'id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'created_at': datetime.datetime(2026, 8, 11, 4, 41, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 41, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa/file', 'properties': {}}, 'image_service': } Aug 11 06:41:16 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Trying to clone 3f598cc8-8afc-4c0f-8707-084242bf5f9b from image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:41:17 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Image download 0.00 MB at 0.00 MB/s Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9f5673-f4ac-4df4-9f04-f874b6f93a48]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:17 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:17 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:17 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.403s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:17 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e Aug 11 06:41:17 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:17 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:17 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a.5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" returned: 0 in 0.292s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:17 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:17 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e" released by "_delete_snapshot" :: held 1.925s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" released by "delete_snapshot" :: held 1.951s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Created reservations ['632aad4d-28f4-4ecf-9ac9-4ce13a4b979c', '0f34f03c-42ac-437c-8dbc-3f6c72cd2002', '6fd556b6-fece-41bd-af47-c7aac1478f8f', '95903670-0be7-4726-bcb6-b6e07105151b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:17 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:41:17 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Temporary image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa is fetched for user 94a116fc414c42e8b410f87314da75ac. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:41:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Delete snapshot completed successfully. Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-da0b36cc-aae2-4313-a2f8-7b6339e47a39 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-5de908f1-cd20-4d6d-9ba1-76fbecc22e0e-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0e4a1f-04f0-4224-b098-b2275493b6d2]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:18 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:18 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:18 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:18 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:18 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:18 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f598cc8-8afc-4c0f-8707-084242bf5f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47fcccff771d456785c6fc54b9e95b25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:17Z,use_quota=True,user_id='94a116fc414c42e8b410f87314da75ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Creating volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:18 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:41:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:18 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1073741824 Aug 11 06:41:18 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-f7559ae9-5ab1-4f23-bf26-f4207739881a-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-f7559ae9-5ab1-4f23-bf26-f4207739881a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1104745-62ff-46c5-b9b7-b8db8b85526f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:19 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:41:19 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:19 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1073741824" returned: 0 in 0.686s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:19 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b Aug 11 06:41:19 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:19 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.669s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:19 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a Aug 11 06:41:19 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:20 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:20 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7559ae9-5ab1-4f23-bf26-f4207739881a" returned: 0 in 0.352s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Attempting download of 7467b4d7-c8d4-45e5-99ca-5a3db39543aa ((None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}])) to volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-f7559ae9-5ab1-4f23-bf26-f4207739881a" released by "delete_volume" :: held 1.163s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29d6bd-05de-418c-a718-630827fb6fe9]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Created reservations ['7197faf1-704e-4a94-9458-dce06f065fbe', '8dfc927c-ff5c-4197-99f8-dd0b31650ca4', 'e5f5e319-61e8-4433-bf11-9574559abac5', '18aed702-f2d3-488c-b2f5-f25d5c7e3450'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:20 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe Aug 11 06:41:20 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:20 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:20 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:20 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe" returned: 0 in 0.490s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:20 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.332s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Deleted volume successfully. Aug 11 06:41:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-71c259ca-27f4-41ee-896f-5205d8abcf24 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-f7559ae9-5ab1-4f23-bf26-f4207739881a-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:20 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe Aug 11 06:41:21 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:21 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe" returned: 1 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_lzqvjlwe' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e671c3c-2951-427a-9fc1-58928b123b38]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-3970c527-8157-4234-a81b-2dbc0f1050cb-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-3970c527-8157-4234-a81b-2dbc0f1050cb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:21 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:21 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7738c-859a-49d4-ab8e-7f3c5827a0ce]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:21 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb Aug 11 06:41:21 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:21 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:21 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD Aug 11 06:41:21 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:22 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:22 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb Aug 11 06:41:22 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:22 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] 7467b4d7-c8d4-45e5-99ca-5a3db39543aa was raw, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:22 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b Aug 11 06:41:22 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:22 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3970c527-8157-4234-a81b-2dbc0f1050cb" returned: 0 in 0.253s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-quobyte-3970c527-8157-4234-a81b-2dbc0f1050cb" released by "delete_volume" :: held 0.743s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Created reservations ['af04b764-d3ac-489e-90e1-80e5143eabe2', 'a3297788-5bd5-4769-897c-d66853611a6c', '4eb1e202-69d7-4089-91e1-880f12cc3c35', 'ad6f536c-055a-4d08-8766-0c72d8649b1c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:22 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:22 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:22 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Deleted volume successfully. Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-667990f9-afb6-4b0c-8fdf-bcfe56fad488 tempest-VolumeDependencyTests-399219883 None] Lock "cinder-3970c527-8157-4234-a81b-2dbc0f1050cb-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:22 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b" returned: 0 in 0.635s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7467b4d7-c8d4-45e5-99ca-5a3db39543aa_mrnrux_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:41:22 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 06:41:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:22 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1G Aug 11 06:41:22 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:23 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b 1G" returned: 0 in 0.384s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Downloaded image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa ((None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}])) to volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Temporary image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa for user 94a116fc414c42e8b410f87314da75ac is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Marking volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Copying metadata from image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa to 3f598cc8-8afc-4c0f-8707-084242bf5f9b. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Creating volume glance metadata for volume 3f598cc8-8afc-4c0f-8707-084242bf5f9b backed by image 7467b4d7-c8d4-45e5-99ca-5a3db39543aa with: {'image_id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0eab0d1bde69bc9afd2b7703e4ec2469', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf983aa8-4267-4f2f-a6c7-be3af8e4afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b', 'volume_size': 1, 'image_id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0eab0d1bde69bc9afd2b7703e4ec2469', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47fcccff771d456785c6fc54b9e95b25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '790d89a37bf11037607d4aebe97ac34c179f3bd5650a5b46cd38cbe0dcd65b3feff1749b0cfb8f0f9b1df45d0be5c2f45068b323c0498aafcb2c09cd65c8c2a5', 'id': '7467b4d7-c8d4-45e5-99ca-5a3db39543aa', 'created_at': datetime.datetime(2026, 8, 11, 4, 41, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 41, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7467b4d7-c8d4-45e5-99ca-5a3db39543aa/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac14e05-e42e-4be1-b2c8-c1e05e5ba569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Volume volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b (3f598cc8-8afc-4c0f-8707-084242bf5f9b): created successfully Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac14e05-e42e-4be1-b2c8-c1e05e5ba569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Flow 'volume_create_manager' (da9830b4-b05f-4f54-8549-692c22e833f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2b736c56-6de7-497f-89cb-87b519e2ef5f tempest-VolumeImageDependencyTests-447412127 None] Created volume successfully. Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Acquiring lock "cinder-3f598cc8-8afc-4c0f-8707-084242bf5f9b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "cinder-3f598cc8-8afc-4c0f-8707-084242bf5f9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Acquiring lock "cinder-quobyte-3f598cc8-8afc-4c0f-8707-084242bf5f9b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "cinder-quobyte-3f598cc8-8afc-4c0f-8707-084242bf5f9b" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c49ea-fed4-4b0e-a241-5eaceebcac9d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:24 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b Aug 11 06:41:24 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (b30e9876-762b-4806-94de-3454d503deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b713c-46cf-475d-a685-7311e64ebf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b713c-46cf-475d-a685-7311e64ebf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-372467708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe65b9-1fd7-42de-b03b-92e654cff4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:25Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8056d6c-7900-4fe5-9f69-416cede4e5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8056d6c-7900-4fe5-9f69-416cede4e5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e2becc-e4f3-4f68-ad68-c55fac8e306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e2becc-e4f3-4f68-ad68-c55fac8e306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fe65b9-1fd7-42de-b03b-92e654cff4f4', 'volume_name': 'volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62271335-9d2c-43c1-9d54-c707533dbf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62271335-9d2c-43c1-9d54-c707533dbf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcdd810-6885-4f19-adb6-28776fde5516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Volume 95fe65b9-1fd7-42de-b03b-92e654cff4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4', 'volume_size': 1} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-372467708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe65b9-1fd7-42de-b03b-92e654cff4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:25Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Creating volume 95fe65b9-1fd7-42de-b03b-92e654cff4f4 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:24 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:41:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:25 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 1073741824 Aug 11 06:41:25 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:25 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:25 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b Aug 11 06:41:25 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:25 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3f598cc8-8afc-4c0f-8707-084242bf5f9b" returned: 0 in 0.350s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "cinder-quobyte-3f598cc8-8afc-4c0f-8707-084242bf5f9b" released by "delete_volume" :: held 0.979s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:25 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 1073741824" returned: 0 in 0.566s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Created reservations ['5bc928e1-557f-4a14-9ed4-934daafe7057', '83c6349f-ff67-4de0-9a00-7038c5be4ad8', '00002008-ed29-4f10-8de8-84fb9b75bcc1', '13ce27a1-a8f0-41c4-a257-36cb19209bc7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:25 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 Aug 11 06:41:25 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:25 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:25 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:25 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4" returned: 0 in 0.397s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:26 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bcdd810-6885-4f19-adb6-28776fde5516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e138df1f-f3eb-4846-9e16-9fa58468413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Deleted volume successfully. Aug 11 06:41:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Volume volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 (95fe65b9-1fd7-42de-b03b-92e654cff4f4): created successfully Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e138df1f-f3eb-4846-9e16-9fa58468413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (b30e9876-762b-4806-94de-3454d503deee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:26 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-42908713-7ec9-49f8-baaf-ff04ef19496f tempest-VolumeImageDependencyTests-447412127 None] Lock "cinder-3f598cc8-8afc-4c0f-8707-084242bf5f9b-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dbab18ee-e2df-4a9f-8ea8-6ec6ab66df97 tempest-AttachVolumeNegativeTest-40958079 None] Created volume successfully. Aug 11 06:41:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6ef97af3-3898-4975-aaa1-2396fa861e97 req-5f864e14-3380-4f81-93b3-04a7adbbbe0e tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6ef97af3-3898-4975-aaa1-2396fa861e97 req-5f864e14-3380-4f81-93b3-04a7adbbbe0e tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-6ef97af3-3898-4975-aaa1-2396fa861e97 req-5f864e14-3380-4f81-93b3-04a7adbbbe0e tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-6ef97af3-3898-4975-aaa1-2396fa861e97 req-5f864e14-3380-4f81-93b3-04a7adbbbe0e tempest-AttachVolumeNegativeTest-40958079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b61761b-91ff-4d79-ab83-f6fc75d3b6ed', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:41:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-6ef97af3-3898-4975-aaa1-2396fa861e97 req-5f864e14-3380-4f81-93b3-04a7adbbbe0e tempest-AttachVolumeNegativeTest-40958079 None] attachment_update completed successfully. Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (0a9e831d-1316-476a-8a3c-930f8dd60001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122859a7-5107-4ac0-b587-cb81f3174d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122859a7-5107-4ac0-b587-cb81f3174d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-617862498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71511bb0-6633-45e5-adb2-4da67b91637e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:37Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae06c156-280b-4b88-b3c5-4f9343cea3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae06c156-280b-4b88-b3c5-4f9343cea3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555df1c-e0ec-433f-861f-c8075ff09017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5555df1c-e0ec-433f-861f-c8075ff09017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71511bb0-6633-45e5-adb2-4da67b91637e', 'volume_name': 'volume-71511bb0-6633-45e5-adb2-4da67b91637e', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9902a9b8-9081-4ddf-a299-fc7da327ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9902a9b8-9081-4ddf-a299-fc7da327ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc326b3a-db49-4502-b4c1-8696f37c236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:37 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume 71511bb0-6633-45e5-adb2-4da67b91637e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71511bb0-6633-45e5-adb2-4da67b91637e', 'volume_size': 1} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-617862498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71511bb0-6633-45e5-adb2-4da67b91637e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:37Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating volume 71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:37 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:37 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e 1073741824 Aug 11 06:41:37 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:37 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e 1073741824" returned: 0 in 0.547s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:37 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e Aug 11 06:41:37 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:37 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e" returned: 0 in 0.330s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc326b3a-db49-4502-b4c1-8696f37c236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71511bb0-6633-45e5-adb2-4da67b91637e', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210f8490-2d4d-453b-b3d1-b9e217f62ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:37 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume volume-71511bb0-6633-45e5-adb2-4da67b91637e (71511bb0-6633-45e5-adb2-4da67b91637e): created successfully Aug 11 06:41:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (210f8490-2d4d-453b-b3d1-b9e217f62ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (0a9e831d-1316-476a-8a3c-930f8dd60001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-26fc5ae2-1326-426a-8e2e-c0296b71fd33 tempest-VolumesSnapshotTestJSON-1800372035 None] Created volume successfully. Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Creating offline snapshot 6eb423ed-a94e-4d11-9e8e-7c2b0286eaed of volume 71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dddf2b9-61a5-4b32-bbf4-be95a17019af]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:39 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e Aug 11 06:41:39 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:39 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:39 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed 1G Aug 11 06:41:39 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:40 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed 1G" returned: 0 in 0.472s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71511bb0-6633-45e5-adb2-4da67b91637e -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:40 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71511bb0-6633-45e5-adb2-4da67b91637e -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed Aug 11 06:41:40 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:40 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71511bb0-6633-45e5-adb2-4da67b91637e -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" returned: 0 in 0.463s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:40 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed is being set with open permissions: ugo+rw Aug 11 06:41:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:40 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed Aug 11 06:41:40 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:40 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" returned: 0 in 0.332s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:41 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info Aug 11 06:41:41 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:41 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:41 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info is being set with open permissions: ugo+rw Aug 11 06:41:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:41 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info Aug 11 06:41:41 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:41 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.info" returned: 0 in 0.302s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-72827ac0-7c31-4a0f-861b-4b37c7d629bf tempest-VolumesSnapshotTestJSON-1800372035 None] Create snapshot completed successfully Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Deleting offline snapshot 6eb423ed-a94e-4d11-9e8e-7c2b0286eaed of volume 71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] snapshot_file for this snap is: volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e474cc0-93eb-443b-87d6-c7de02747970]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:43 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed Aug 11 06:41:43 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:43 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71511bb0-6633-45e5-adb2-4da67b91637e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19df4b-13ec-45ea-81e6-dbfc5715dfec]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:43 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e Aug 11 06:41:43 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:43 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e" returned: 0 in 0.367s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:43 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed Aug 11 06:41:43 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:44 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" returned: 0 in 0.406s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:44 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed Aug 11 06:41:44 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:44 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e.6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed" released by "_delete_snapshot" :: held 1.648s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" released by "delete_snapshot" :: held 1.700s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['a74cf172-e732-4c90-8e57-b72105de6d8e', 'e076d373-c92f-4321-bc59-168acbebf65d', 'eb36255b-84e6-40ac-9100-d52ce85be1d1', '2d0e0799-5995-4e6f-83da-7f24ef861b1b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Delete snapshot completed successfully. Aug 11 06:41:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-301216e0-8cb5-42de-bfa2-a2fef02bf67f tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-6eb423ed-a94e-4d11-9e8e-7c2b0286eaed-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (6da9222f-0c1b-4d6d-9a69-35f1108665ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215b249b-86cb-40ba-b689-3a4799ff5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215b249b-86cb-40ba-b689-3a4799ff5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17056420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b403d118-338d-4b78-bead-71f933134a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:46Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d377a876-0df4-4195-adc1-7aec78d57a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d377a876-0df4-4195-adc1-7aec78d57a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d7ee5-8571-48b0-b409-b768a3bd9735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d7ee5-8571-48b0-b409-b768a3bd9735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b403d118-338d-4b78-bead-71f933134a02', 'volume_name': 'volume-b403d118-338d-4b78-bead-71f933134a02', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a00aefb-b1ad-4de0-a0d2-617dea8fc449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a00aefb-b1ad-4de0-a0d2-617dea8fc449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5334d09d-8f50-4480-8c20-6b98f848b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Volume b403d118-338d-4b78-bead-71f933134a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b403d118-338d-4b78-bead-71f933134a02', 'volume_size': 1} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17056420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b403d118-338d-4b78-bead-71f933134a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:46Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Creating volume b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:45 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:41:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:45 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 1073741824 Aug 11 06:41:45 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:46 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 1073741824" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:46 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:41:46 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:46 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5334d09d-8f50-4480-8c20-6b98f848b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b403d118-338d-4b78-bead-71f933134a02', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37168ae-3a2c-40f9-bc20-6c34fae47299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Volume volume-b403d118-338d-4b78-bead-71f933134a02 (b403d118-338d-4b78-bead-71f933134a02): created successfully Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37168ae-3a2c-40f9-bc20-6c34fae47299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (6da9222f-0c1b-4d6d-9a69-35f1108665ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-10edab88-13ba-425e-aaf3-60133292265a tempest-VolumesSnapshotTestJSON-1800372035 None] Created volume successfully. Aug 11 06:41:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating offline snapshot 6c4ee888-453f-4282-8803-fb20af254193 of volume b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:41:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b1aa36-8759-4a14-9752-4838144e10be]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:48 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:41:48 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:48 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.397s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:48 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 1G Aug 11 06:41:48 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:48 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 1G" returned: 0 in 0.436s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403d118-338d-4b78-bead-71f933134a02 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:48 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403d118-338d-4b78-bead-71f933134a02 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:41:48 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:49 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403d118-338d-4b78-bead-71f933134a02 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.332s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:49 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 is being set with open permissions: ugo+rw Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:49 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:41:49 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:49 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=85,cinder:UPDATE=70,cinder:INSERT=25,cinder:DELETE=8 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:49 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info Aug 11 06:41:49 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:49 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info" returned: 0 in 0.306s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:49 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info is being set with open permissions: ugo+rw Aug 11 06:41:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:49 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info Aug 11 06:41:49 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:50 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.info" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:50 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=84,cinder:UPDATE=87,cinder:INSERT=30,cinder:DELETE=5 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:41:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4ccd6ad8-b69b-49c2-8363-71bb38b5c328 tempest-VolumesSnapshotTestJSON-1800372035 None] Create snapshot completed successfully Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (98fcd68f-8548-4c23-90b4-beb8b3d2b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e55b85-bc03-4333-a35d-73b12f9491e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e55b85-bc03-4333-a35d-73b12f9491e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2050499786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bfd52b-9bc1-4c7d-8d09-298053993363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:41:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6c4ee888-453f-4282-8803-fb20af254193,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:41:52Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e03365-6d76-4658-bce6-54202bf4c5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e03365-6d76-4658-bce6-54202bf4c5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49521570-2464-4b7d-a554-6a852c948eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49521570-2464-4b7d-a554-6a852c948eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83bfd52b-9bc1-4c7d-8d09-298053993363', 'volume_name': 'volume-83bfd52b-9bc1-4c7d-8d09-298053993363', 'volume_size': 2, 'snapshot_id': '6c4ee888-453f-4282-8803-fb20af254193'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba2006-2458-4464-8f5f-0a6c3bad5045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ba2006-2458-4464-8f5f-0a6c3bad5045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f4e087-4c9e-4177-8f7a-2db5c5c26f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:51 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume 83bfd52b-9bc1-4c7d-8d09-298053993363: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83bfd52b-9bc1-4c7d-8d09-298053993363', 'volume_size': 2, 'snapshot_id': '6c4ee888-453f-4282-8803-fb20af254193'} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193-83bfd52b-9bc1-4c7d-8d09-298053993363" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193-83bfd52b-9bc1-4c7d-8d09-298053993363" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating volume 83bfd52b-9bc1-4c7d-8d09-298053993363 from snapshot 6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] snapshot: 6c4ee888-453f-4282-8803-fb20af254193, volume: 83bfd52b-9bc1-4c7d-8d09-298053993363, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fa42c-3d4c-4043-a80b-bb5a2e2f2f26]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:51 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:41:51 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:52 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403d118-338d-4b78-bead-71f933134a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ca9fb-66e8-49c0-ac83-13fe9c6e2327]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:52 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:41:52 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:52 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:41:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:52 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 Aug 11 06:41:52 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:57 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363" returned: 0 in 4.949s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:41:57 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Converted 1024.00 MB image at 206.86 MB/s Aug 11 06:41:57 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 is being set with open permissions: ugo+rw Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:57 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 Aug 11 06:41:57 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:57 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" released by "_copy_volume_from_snapshot" :: held 6.067s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193-83bfd52b-9bc1-4c7d-8d09-298053993363" released by "_create_volume_from_snapshot" :: held 6.142s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.161s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f4e087-4c9e-4177-8f7a-2db5c5c26f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bfd52b-9bc1-4c7d-8d09-298053993363', 'volume_size': 2, 'snapshot_id': '6c4ee888-453f-4282-8803-fb20af254193'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1362c039-6709-49e5-97d3-110beeb2034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:41:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume volume-83bfd52b-9bc1-4c7d-8d09-298053993363 (83bfd52b-9bc1-4c7d-8d09-298053993363): created successfully Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1362c039-6709-49e5-97d3-110beeb2034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:41:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (98fcd68f-8548-4c23-90b4-beb8b3d2b496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:41:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0040edfe-3334-4f8e-a040-ae5b31780254 tempest-VolumesSnapshotTestJSON-1800372035 None] Created volume successfully. Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-83bfd52b-9bc1-4c7d-8d09-298053993363-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-83bfd52b-9bc1-4c7d-8d09-298053993363-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b67b7-43a0-488e-b14d-f1624ba2a5ba]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:58 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 Aug 11 06:41:58 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:58 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:58 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363 Aug 11 06:41:58 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:59 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-83bfd52b-9bc1-4c7d-8d09-298053993363" returned: 0 in 0.248s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-83bfd52b-9bc1-4c7d-8d09-298053993363" released by "delete_volume" :: held 0.659s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['619385b2-2695-490c-a949-1b878e5483d3', '690449b2-c221-43a9-8e6f-8c15699e7210', '9e198c95-a76b-4dc6-8ea4-20c4aad6fd59', '92804ba6-5240-49ed-be4d-0ef8f84d67bd'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:59 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:41:59 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:41:59 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:41:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleted volume successfully. Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5098c2f8-9859-40fa-8fd7-f6203f436790 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-83bfd52b-9bc1-4c7d-8d09-298053993363-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-6c4ee888-453f-4282-8803-fb20af254193-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-6c4ee888-453f-4282-8803-fb20af254193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleting offline snapshot 6c4ee888-453f-4282-8803-fb20af254193 of volume b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] snapshot_file for this snap is: volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dcce86-3291-452c-8634-5ed038b69503]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:41:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:41:59 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:41:59 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:00 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.367s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403d118-338d-4b78-bead-71f933134a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d1ffc2-e22b-44ec-b3d9-4598669fd538]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:00 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:42:00 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:00 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.635s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:00 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:42:00 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:01 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:01 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193 Aug 11 06:42:01 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:01 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02.6c4ee888-453f-4282-8803-fb20af254193" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-6c4ee888-453f-4282-8803-fb20af254193" released by "_delete_snapshot" :: held 1.723s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" released by "delete_snapshot" :: held 1.746s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['0bacc1c8-7eb5-425c-a208-ac93c7010321', '669faa04-fbdf-471f-996a-52e488d2a719', 'b869630c-952b-4296-a04e-1a72e4ee4589', 'b2e5e1e5-d2d1-4589-8e70-0b6ef24e8ef3'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Delete snapshot completed successfully. Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-bb18a749-5348-42b1-9daf-c6ef6fb78177 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-6c4ee888-453f-4282-8803-fb20af254193-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-b403d118-338d-4b78-bead-71f933134a02-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-b403d118-338d-4b78-bead-71f933134a02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd3c23-b22d-42c7-9604-97857f935d44]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:02 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:42:02 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:02 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.364s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:02 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02 Aug 11 06:42:02 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:02 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b403d118-338d-4b78-bead-71f933134a02" returned: 0 in 0.258s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-b403d118-338d-4b78-bead-71f933134a02" released by "delete_volume" :: held 0.682s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['e9e9b719-137d-4aa2-a004-1cd58cf12a97', '4910c88d-1af8-46dc-a588-5aa9352b3101', '75d95c15-87c4-440f-8fab-ebfe2118bdd4', '1ff0c6f5-f3a8-404a-b2d1-1a92a5ddcd42'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:02 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:42:02 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:03 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.253s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:42:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleted volume successfully. Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c9bb4975-5570-4f7f-9904-3d4a7a928e44 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-b403d118-338d-4b78-bead-71f933134a02-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (fdc93b5f-aa3d-41ec-ad47-22366b00ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931e281b-5b53-46d8-8f5e-e8551e3467cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931e281b-5b53-46d8-8f5e-e8551e3467cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140964284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadf6293-5ad5-45a0-b3c7-4da7555ae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:04Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d327a-00c4-4c58-b3e3-cb272d5b954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d327a-00c4-4c58-b3e3-cb272d5b954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2c40d8-5736-4fdc-9f0c-04b840d23cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2c40d8-5736-4fdc-9f0c-04b840d23cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadf6293-5ad5-45a0-b3c7-4da7555ae50f', 'volume_name': 'volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e260f5-7611-497c-b4df-034c7444db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e260f5-7611-497c-b4df-034c7444db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11fcec6-5ab0-476c-94d0-089e5b806b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume dadf6293-5ad5-45a0-b3c7-4da7555ae50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f', 'volume_size': 1} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140964284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadf6293-5ad5-45a0-b3c7-4da7555ae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:04Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating volume dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:42:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:03 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f 1073741824 Aug 11 06:42:03 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:04 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f 1073741824" returned: 0 in 0.421s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:04 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:04 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:04 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11fcec6-5ab0-476c-94d0-089e5b806b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2a4cc7-9735-42e6-9e3b-3baa3db1acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f (dadf6293-5ad5-45a0-b3c7-4da7555ae50f): created successfully Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2a4cc7-9735-42e6-9e3b-3baa3db1acbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (fdc93b5f-aa3d-41ec-ad47-22366b00ff84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4bca625c-0d56-4ab4-b4f3-4784b6c3d141 tempest-VolumesSnapshotTestJSON-1800372035 None] Created volume successfully. Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Creating offline snapshot 155f4791-3649-4b7a-8af8-332d6ba72c87 of volume dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e5be61-bf31-49ef-a649-4c26a2af659f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:04 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:04 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:05 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.394s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:05 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 1G Aug 11 06:42:05 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:05 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 1G" returned: 0 in 0.467s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:05 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:05 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:06 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.326s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 is being set with open permissions: ugo+rw Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:06 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:06 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:06 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.263s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:06 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info Aug 11 06:42:06 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:06 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info is being set with open permissions: ugo+rw Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:06 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info Aug 11 06:42:06 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:06 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.info" returned: 0 in 0.265s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-77a1357f-da11-4df0-9d78-7413f9943b7c tempest-VolumesSnapshotTestJSON-1800372035 None] Create snapshot completed successfully Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (d040d825-c6d1-4845-90c4-076b507e750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55623e73-0361-49d4-b848-98ed55a2c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55623e73-0361-49d4-b848-98ed55a2c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1123212334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5fcd63-512d-45e7-930f-3a87fc50cba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91d0274c3842497583d4c37ceef83217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=155f4791-3649-4b7a-8af8-332d6ba72c87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:08Z,use_quota=True,user_id='edbb882488dd47f18a967dd75a767913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79394764-5acd-44b7-af7c-1bee9ac4bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79394764-5acd-44b7-af7c-1bee9ac4bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af292883-e7a9-48e2-8035-bfeb2787e0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af292883-e7a9-48e2-8035-bfeb2787e0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de5fcd63-512d-45e7-930f-3a87fc50cba5', 'volume_name': 'volume-de5fcd63-512d-45e7-930f-3a87fc50cba5', 'volume_size': 1, 'snapshot_id': '155f4791-3649-4b7a-8af8-332d6ba72c87'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6066e219-487f-4537-a0d5-9df0969eafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6066e219-487f-4537-a0d5-9df0969eafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac0e902-93ab-4d94-93fe-fac099c924c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume de5fcd63-512d-45e7-930f-3a87fc50cba5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de5fcd63-512d-45e7-930f-3a87fc50cba5', 'volume_size': 1, 'snapshot_id': '155f4791-3649-4b7a-8af8-332d6ba72c87'} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87-de5fcd63-512d-45e7-930f-3a87fc50cba5" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87-de5fcd63-512d-45e7-930f-3a87fc50cba5" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating volume de5fcd63-512d-45e7-930f-3a87fc50cba5 from snapshot 155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] snapshot: 155f4791-3649-4b7a-8af8-332d6ba72c87, volume: de5fcd63-512d-45e7-930f-3a87fc50cba5, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9097539a-2e52-45e7-afcd-7045e4f8d92f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:08 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:08 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:09 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[500778f1-de92-4ad6-9298-547dce75c8f9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:09 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:09 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:09 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.405s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:42:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:09 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 Aug 11 06:42:09 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:14 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5" returned: 0 in 4.709s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:42:14 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Converted 1024.00 MB image at 217.39 MB/s Aug 11 06:42:14 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 is being set with open permissions: ugo+rw Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:14 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 Aug 11 06:42:14 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:14 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" released by "_copy_volume_from_snapshot" :: held 5.945s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87-de5fcd63-512d-45e7-930f-3a87fc50cba5" released by "_create_volume_from_snapshot" :: held 6.063s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.088s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac0e902-93ab-4d94-93fe-fac099c924c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5fcd63-512d-45e7-930f-3a87fc50cba5', 'volume_size': 1, 'snapshot_id': '155f4791-3649-4b7a-8af8-332d6ba72c87'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ebf38b-990a-4361-b5ea-c5f741c835df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Volume volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 (de5fcd63-512d-45e7-930f-3a87fc50cba5): created successfully Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ebf38b-990a-4361-b5ea-c5f741c835df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Flow 'volume_create_manager' (d040d825-c6d1-4845-90c4-076b507e750a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5106d9da-c2be-456f-8ad5-38868d690292 tempest-VolumesSnapshotTestJSON-1800372035 None] Created volume successfully. Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:15 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:42:15 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:15 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-de5fcd63-512d-45e7-930f-3a87fc50cba5-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-de5fcd63-512d-45e7-930f-3a87fc50cba5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094544d-34cb-4b28-bb8c-a00e87e5fae6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:15 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 Aug 11 06:42:15 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-620a6dfa-e71a-4fff-8817-e1b94c64348a req-6cae7cc7-5818-471f-b873-f29cbd2e888f tempest-AttachVolumeNegativeTest-40958079 None] Terminate volume connection completed successfully. Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-620a6dfa-e71a-4fff-8817-e1b94c64348a req-6cae7cc7-5818-471f-b873-f29cbd2e888f tempest-AttachVolumeNegativeTest-40958079 None] Deleting attachment 4b61761b-91ff-4d79-ab83-f6fc75d3b6ed. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:42:16 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:16 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5 Aug 11 06:42:16 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:16 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de5fcd63-512d-45e7-930f-3a87fc50cba5" returned: 0 in 0.274s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-de5fcd63-512d-45e7-930f-3a87fc50cba5" released by "delete_volume" :: held 0.749s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['0db2e776-7fc5-4d9c-96e9-5212e3c84a2a', 'df13be26-5758-46ca-884d-612ed56776fa', '2e75e9d4-c274-42f3-8538-5a770c1f0c7a', '1b0e5441-b65b-4e01-a029-e882e5e4a479'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:16 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:42:16 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:16 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.269s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:42:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Deleted volume successfully. Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c6eb3956-e32d-43d6-98a3-68f8df9a9cae tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-de5fcd63-512d-45e7-930f-3a87fc50cba5-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-155f4791-3649-4b7a-8af8-332d6ba72c87-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-155f4791-3649-4b7a-8af8-332d6ba72c87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleting offline snapshot 155f4791-3649-4b7a-8af8-332d6ba72c87 of volume dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] snapshot_file for this snap is: volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d161b-ee5b-4179-91f4-4fa8de86d5ee]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:16 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:16 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:17 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.519s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:42:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f9c148-0c5b-4220-8a3d-3a455ef87197]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:17 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:17 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:18 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.617s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:18 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:18 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:18 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.452s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:18 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87 Aug 11 06:42:18 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:18 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f.155f4791-3649-4b7a-8af8-332d6ba72c87" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-155f4791-3649-4b7a-8af8-332d6ba72c87" released by "_delete_snapshot" :: held 2.029s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" released by "delete_snapshot" :: held 2.067s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:18 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['08e098b4-7ba1-4677-b7eb-595c56d83320', '2b7a6968-5d37-4ae1-b9bf-89b49589f297', '39763342-5813-414d-b0a8-8932062d3773', 'b03d4174-63ee-47fc-97de-7fcef8a744c8'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Delete snapshot completed successfully. Aug 11 06:42:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a824ce93-8762-4856-86bb-1a16e3f568e0 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-155f4791-3649-4b7a-8af8-332d6ba72c87-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-dadf6293-5ad5-45a0-b3c7-4da7555ae50f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-dadf6293-5ad5-45a0-b3c7-4da7555ae50f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c834eb2-687a-4d0b-81ff-4856fe9ba173]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:20 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:20 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:20 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.433s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:20 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f Aug 11 06:42:20 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:20 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-dadf6293-5ad5-45a0-b3c7-4da7555ae50f" released by "delete_volume" :: held 0.780s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['86234765-ca62-45f0-9ccc-6140fe8d3b60', 'f6305dd5-df2c-4d52-8dcb-8818a26df923', '2ec705bc-5471-4948-a97f-13eca59e4660', '1e555612-672a-4ec3-b18d-6dfbc9ee7ed8'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:21 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:42:21 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-71511bb0-6633-45e5-adb2-4da67b91637e-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-71511bb0-6633-45e5-adb2-4da67b91637e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:21 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:42:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleted volume successfully. Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-39edb30e-e796-42ff-9e96-177ff16ccd83 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-dadf6293-5ad5-45a0-b3c7-4da7555ae50f-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dadf4cd-b0b0-433a-bc24-58448be9502e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:21 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e Aug 11 06:42:21 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:21 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e" returned: 0 in 0.396s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:21 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e Aug 11 06:42:21 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:22 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-71511bb0-6633-45e5-adb2-4da67b91637e" returned: 0 in 0.246s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-quobyte-71511bb0-6633-45e5-adb2-4da67b91637e" released by "delete_volume" :: held 0.718s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Created reservations ['2aec3440-14de-41cd-ad2f-e777e40d6191', '16383d11-8982-47e4-90ea-ee6d5f5ffbe2', '40189b3a-2f56-4b7d-90da-1c4d0a687209', '549d00d2-388d-48d2-8d8b-6b9afab65964'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:22 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:42:22 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:22 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:42:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Deleted volume successfully. Aug 11 06:42:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-534ebb83-c10e-4c92-8798-1a98014cc887 tempest-VolumesSnapshotTestJSON-1800372035 None] Lock "cinder-71511bb0-6633-45e5-adb2-4da67b91637e-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:42:32 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=64,cinder:DELETE=4,cinder:SELECT=54,cinder:INSERT=14 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:42:32 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=45,cinder:UPDATE=60,cinder:INSERT=18,cinder:DELETE=6 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (52166810-ee9c-4159-95a9-09804e8bb4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf0c4b-8b76-4dac-9a8a-4feb63e30dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf0c4b-8b76-4dac-9a8a-4feb63e30dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1561657851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438ea73-63bb-465d-ab89-00f19a9290f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:53Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21127793-fd5b-4f95-900d-701382d883fd),volume_type_id=21127793-fd5b-4f95-900d-701382d883fd)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e34c8-f2d2-45ac-a16d-7ad9f5ffd451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b48e34c8-f2d2-45ac-a16d-7ad9f5ffd451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26685e-dbd2-4689-a50d-fdb9d4424260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26685e-dbd2-4689-a50d-fdb9d4424260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8438ea73-63bb-465d-ab89-00f19a9290f8', 'volume_name': 'volume-8438ea73-63bb-465d-ab89-00f19a9290f8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79f841-9462-4c9c-8803-d9f78fb6bfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a79f841-9462-4c9c-8803-d9f78fb6bfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcd83e-0017-414e-b3f4-8e508eb50263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume 8438ea73-63bb-465d-ab89-00f19a9290f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8438ea73-63bb-465d-ab89-00f19a9290f8', 'volume_size': 1} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1561657851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8438ea73-63bb-465d-ab89-00f19a9290f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:53Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21127793-fd5b-4f95-900d-701382d883fd),volume_type_id=21127793-fd5b-4f95-900d-701382d883fd)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Creating volume 8438ea73-63bb-465d-ab89-00f19a9290f8 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:53 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:53 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 1073741824 Aug 11 06:42:53 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (1a889c7c-08be-4601-a08d-074e2577340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2c5723-470f-452d-9bbf-66db4f6ef1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2c5723-470f-452d-9bbf-66db4f6ef1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1171285027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a4172c-93e7-42be-86ef-8e0ec1d74049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:53Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f78b41-aa0a-4a79-9939-274e9fc6c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f78b41-aa0a-4a79-9939-274e9fc6c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8516653d-bcad-454e-a28f-1dd8d22fd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8516653d-bcad-454e-a28f-1dd8d22fd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a4172c-93e7-42be-86ef-8e0ec1d74049', 'volume_name': 'volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eb100d-0e34-4459-bbd3-2d26b9932c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eb100d-0e34-4459-bbd3-2d26b9932c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d9a3c4-5034-4af4-b050-fec8cc1b0dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Volume d2a4172c-93e7-42be-86ef-8e0ec1d74049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049', 'volume_size': 1} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (f73b6ca9-b993-4c91-a38c-68645160152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b860cd-f27a-41b7-b000-f8ce2e1524e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b860cd-f27a-41b7-b000-f8ce2e1524e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1657994260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b539bd4-ca81-4383-ac25-cfebfe7c4bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:54Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4a3588-4344-49e1-80ce-f0de4dce6d9a),volume_type_id=9d4a3588-4344-49e1-80ce-f0de4dce6d9a)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe1b2dc-07c4-470c-9fa3-e003848c3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe1b2dc-07c4-470c-9fa3-e003848c3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657bc8d0-510f-4980-98d5-ce98059d375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657bc8d0-510f-4980-98d5-ce98059d375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b539bd4-ca81-4383-ac25-cfebfe7c4bd2', 'volume_name': 'volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b8d9ab-9349-4d62-aa03-4245e22ca908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b8d9ab-9349-4d62-aa03-4245e22ca908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9544c2-3098-4582-8461-5c1fa94d2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume 8b539bd4-ca81-4383-ac25-cfebfe7c4bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2', 'volume_size': 1} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:53 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 1073741824" returned: 0 in 0.528s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:53 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 Aug 11 06:42:53 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (fc0722d6-6d7d-4d4c-b4f9-b583ca15812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d0ab91-5554-4ba6-8dc4-f4ac406a19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d0ab91-5554-4ba6-8dc4-f4ac406a19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249636606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b352dcb-d090-4beb-8762-9b4b72b7666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:54Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d7fdd5c-8a92-4c47-824e-818052376410),volume_type_id=6d7fdd5c-8a92-4c47-824e-818052376410)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5581e602-7485-4862-8610-443477386857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5581e602-7485-4862-8610-443477386857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f81218-6daf-4f72-92b8-43440882cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:42:54 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8" returned: 0 in 0.298s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.719s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1171285027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a4172c-93e7-42be-86ef-8e0ec1d74049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:53Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Creating volume d2a4172c-93e7-42be-86ef-8e0ec1d74049 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:54 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcd83e-0017-414e-b3f4-8e508eb50263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8438ea73-63bb-465d-ab89-00f19a9290f8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 1073741824 Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf6224-34a6-42ee-9265-f94dd811a07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume volume-8438ea73-63bb-465d-ab89-00f19a9290f8 (8438ea73-63bb-465d-ab89-00f19a9290f8): created successfully Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf6224-34a6-42ee-9265-f94dd811a07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (52166810-ee9c-4159-95a9-09804e8bb4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b955206f-6341-4951-810b-3ccb4b8e4b98 tempest-TestInstancesWithCinderVolumes-1816519480 None] Created volume successfully. Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f81218-6daf-4f72-92b8-43440882cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b352dcb-d090-4beb-8762-9b4b72b7666b', 'volume_name': 'volume-8b352dcb-d090-4beb-8762-9b4b72b7666b', 'volume_size': 1, 'image_id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--981695633', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff6ce79db15442e3ba58c003789cccfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'created_at': datetime.datetime(2026, 8, 11, 4, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49581f0b-082c-4670-ae47-2b84adba5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49581f0b-082c-4670-ae47-2b84adba5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7158587-6e22-4aef-adb4-8392ec280614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume 8b352dcb-d090-4beb-8762-9b4b72b7666b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b352dcb-d090-4beb-8762-9b4b72b7666b', 'volume_size': 1, 'image_id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--981695633', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff6ce79db15442e3ba58c003789cccfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'created_at': datetime.datetime(2026, 8, 11, 4, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820/file', 'properties': {}}, 'image_service': } Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Trying to clone 8b352dcb-d090-4beb-8762-9b4b72b7666b from image aaf7da41-fb17-4ce0-aede-3fadfd83f820 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:42:54 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 1073741824" returned: 0 in 0.494s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:54 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 Aug 11 06:42:54 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:55 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1657994260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b539bd4-ca81-4383-ac25-cfebfe7c4bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:54Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d4a3588-4344-49e1-80ce-f0de4dce6d9a),volume_type_id=9d4a3588-4344-49e1-80ce-f0de4dce6d9a)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Creating volume 8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:55 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:55 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 1073741824 Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d9a3c4-5034-4af4-b050-fec8cc1b0dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:55 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bf024d-a1cf-4436-b107-c443dc480e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Volume volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 (d2a4172c-93e7-42be-86ef-8e0ec1d74049): created successfully Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bf024d-a1cf-4436-b107-c443dc480e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (1a889c7c-08be-4601-a08d-074e2577340c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5c4429ee-8f91-4315-b41c-3b6c7fc011f0 tempest-AttachVolumeNegativeTest-40958079 None] Created volume successfully. Aug 11 06:42:55 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 1073741824" returned: 0 in 0.458s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:55 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 Aug 11 06:42:55 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:55 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9544c2-3098-4582-8461-5c1fa94d2db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f2af1f-1f3e-45de-90f2-a794b822267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:42:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 (8b539bd4-ca81-4383-ac25-cfebfe7c4bd2): created successfully Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f2af1f-1f3e-45de-90f2-a794b822267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:42:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (f73b6ca9-b993-4c91-a38c-68645160152b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:42:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-22540602-7faf-4087-a1fc-b651104ab017 tempest-TestInstancesWithCinderVolumes-1816519480 None] Created volume successfully. Aug 11 06:42:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-092b6963-a9ea-42ba-baed-9877270859ec req-3be9a0b7-0e0a-49ea-986a-b3562bbac630 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-092b6963-a9ea-42ba-baed-9877270859ec req-3be9a0b7-0e0a-49ea-986a-b3562bbac630 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-092b6963-a9ea-42ba-baed-9877270859ec req-3be9a0b7-0e0a-49ea-986a-b3562bbac630 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-092b6963-a9ea-42ba-baed-9877270859ec req-3be9a0b7-0e0a-49ea-986a-b3562bbac630 tempest-AttachVolumeNegativeTest-40958079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd068f97b-52f4-4444-9485-5d66701b7d6e', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:42:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-092b6963-a9ea-42ba-baed-9877270859ec req-3be9a0b7-0e0a-49ea-986a-b3562bbac630 tempest-AttachVolumeNegativeTest-40958079 None] attachment_update completed successfully. Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD, size 20.69 MB, duration 3.68 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:42:58 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Image download 20.69 MB at 5.62 MB/s Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91dc137-45f8-4857-9944-4ceaa52a29ec]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:58 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD Aug 11 06:42:58 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:58 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Temporary image aaf7da41-fb17-4ce0-aede-3fadfd83f820 is fetched for user d2df9447cc064a5e9dd41b7169c64647. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6d1dd-f3f2-4bc7-91ea-95836114e9a8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:42:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:58 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD Aug 11 06:42:58 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:59 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-249636606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b352dcb-d090-4beb-8762-9b4b72b7666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6ce79db15442e3ba58c003789cccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:42:54Z,use_quota=True,user_id='d2df9447cc064a5e9dd41b7169c64647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d7fdd5c-8a92-4c47-824e-818052376410),volume_type_id=6d7fdd5c-8a92-4c47-824e-818052376410)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Creating volume 8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:42:59 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:59 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1073741824 Aug 11 06:42:59 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:59 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1073741824" returned: 0 in 0.549s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:42:59 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b Aug 11 06:42:59 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:42:59 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b" returned: 0 in 0.275s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:42:59 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Attempting download of aaf7da41-fb17-4ce0-aede-3fadfd83f820 ((None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}])) to volume 8b352dcb-d090-4beb-8762-9b4b72b7666b. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a0d3d-0fd8-42d9-84a9-484f78af2c6c]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-6133829b-20a7-4663-91c4-837b2151de62 req-7dc5c32f-d842-4c3d-bceb-77610d2a3077 tempest-AttachVolumeNegativeTest-40958079 None] Terminate volume connection completed successfully. Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-6133829b-20a7-4663-91c4-837b2151de62 req-7dc5c32f-d842-4c3d-bceb-77610d2a3077 tempest-AttachVolumeNegativeTest-40958079 None] Deleting attachment d068f97b-52f4-4444-9485-5d66701b7d6e. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:43:00 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd Aug 11 06:43:00 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:00 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:00 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd Aug 11 06:43:00 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:00 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd" returned: 1 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aaf7da41-fb17-4ce0-aede-3fadfd83f820_tsd6vbwd' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a0a89e-412b-46f6-9f5e-eb3c0c705b44]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:00 devstack sudo[109884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD Aug 11 06:43:00 devstack sudo[109884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:01 devstack sudo[109884]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:01 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] aaf7da41-fb17-4ce0-aede-3fadfd83f820 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:43:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:01 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b Aug 11 06:43:01 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:03 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b" returned: 0 in 2.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aaf7da41-fb17-4ce0-aede-3fadfd83f820_9gzdipi3devstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:43:03 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Converted 112.00 MB image at 47.09 MB/s Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:03 devstack sudo[109923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1G Aug 11 06:43:03 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:03 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b 1G" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Downloaded image aaf7da41-fb17-4ce0-aede-3fadfd83f820 ((None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}])) to volume 8b352dcb-d090-4beb-8762-9b4b72b7666b successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Temporary image aaf7da41-fb17-4ce0-aede-3fadfd83f820 for user d2df9447cc064a5e9dd41b7169c64647 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Marking volume 8b352dcb-d090-4beb-8762-9b4b72b7666b as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Copying metadata from image aaf7da41-fb17-4ce0-aede-3fadfd83f820 to 8b352dcb-d090-4beb-8762-9b4b72b7666b. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:43:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Creating volume glance metadata for volume 8b352dcb-d090-4beb-8762-9b4b72b7666b backed by image aaf7da41-fb17-4ce0-aede-3fadfd83f820 with: {'image_id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'image_name': 'tempest-scenario-img--981695633', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:43:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7158587-6e22-4aef-adb4-8392ec280614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b352dcb-d090-4beb-8762-9b4b72b7666b', 'volume_size': 1, 'image_id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--981695633', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ff6ce79db15442e3ba58c003789cccfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aaf7da41-fb17-4ce0-aede-3fadfd83f820', 'created_at': datetime.datetime(2026, 8, 11, 4, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 42, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aaf7da41-fb17-4ce0-aede-3fadfd83f820/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084f5640-8216-4876-81fe-0a06ec7b5085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Volume volume-8b352dcb-d090-4beb-8762-9b4b72b7666b (8b352dcb-d090-4beb-8762-9b4b72b7666b): created successfully Aug 11 06:43:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084f5640-8216-4876-81fe-0a06ec7b5085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Flow 'volume_create_manager' (fc0722d6-6d7d-4d4c-b4f9-b583ca15812f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:43:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3eef9f1f-bc24-46f3-aad2-b608f272161d tempest-TestInstancesWithCinderVolumes-1816519480 None] Created volume successfully. Aug 11 06:43:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-94affb3f-2b33-476f-bc99-8260e7ddcc5b req-ba176979-e8c2-46fa-9642-dfb5a206afc5 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-94affb3f-2b33-476f-bc99-8260e7ddcc5b req-ba176979-e8c2-46fa-9642-dfb5a206afc5 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-94affb3f-2b33-476f-bc99-8260e7ddcc5b req-ba176979-e8c2-46fa-9642-dfb5a206afc5 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-94affb3f-2b33-476f-bc99-8260e7ddcc5b req-ba176979-e8c2-46fa-9642-dfb5a206afc5 tempest-TestInstancesWithCinderVolumes-1816519480 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-8b352dcb-d090-4beb-8762-9b4b72b7666b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70e17100-bbb6-42a8-a2bb-7458b58c3c05', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:43:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-94affb3f-2b33-476f-bc99-8260e7ddcc5b req-ba176979-e8c2-46fa-9642-dfb5a206afc5 tempest-TestInstancesWithCinderVolumes-1816519480 None] attachment_update completed successfully. Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:15 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:15 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:15 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.428s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:43:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:43:17 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=22,cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=4 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:43:17 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (462df417-2921-4499-b098-4c79c9a862cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8f981e-28e4-49d4-be16-719b4c0f5458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8f981e-28e4-49d4-be16-719b4c0f5458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-928114582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e45039-f455-424b-9686-d61bbe284c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:43:40Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5867c67-9cbe-43be-a8c1-66aea2e65649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5867c67-9cbe-43be-a8c1-66aea2e65649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762abfb1-48ab-41b5-bb9f-db41a479675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762abfb1-48ab-41b5-bb9f-db41a479675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e45039-f455-424b-9686-d61bbe284c28', 'volume_name': 'volume-44e45039-f455-424b-9686-d61bbe284c28', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe5ad7f-8665-40fc-8ecc-ca36c95a1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe5ad7f-8665-40fc-8ecc-ca36c95a1350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e451238b-a273-40b1-8c32-56235aab67eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Volume 44e45039-f455-424b-9686-d61bbe284c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e45039-f455-424b-9686-d61bbe284c28', 'volume_size': 1} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-928114582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e45039-f455-424b-9686-d61bbe284c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d28e858661c43fc86abd19f6879b98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:43:40Z,use_quota=True,user_id='d396e5908a8f470b8a823d5fd184f00f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Creating volume 44e45039-f455-424b-9686-d61bbe284c28 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:43:39 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:43:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:39 devstack sudo[110617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 1073741824 Aug 11 06:43:39 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:40 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 1073741824" returned: 0 in 0.407s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:40 devstack sudo[110624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 Aug 11 06:43:40 devstack sudo[110624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:40 devstack sudo[110624]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28" returned: 0 in 0.230s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e451238b-a273-40b1-8c32-56235aab67eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e45039-f455-424b-9686-d61bbe284c28', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c6618-e6b2-4a54-b21a-ecda5a6642c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:40 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Volume volume-44e45039-f455-424b-9686-d61bbe284c28 (44e45039-f455-424b-9686-d61bbe284c28): created successfully Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7c6618-e6b2-4a54-b21a-ecda5a6642c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Flow 'volume_create_manager' (462df417-2921-4499-b098-4c79c9a862cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:43:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1a029bac-d3b7-4c75-adb9-fc06a4d98997 tempest-AttachVolumeNegativeTest-40958079 None] Created volume successfully. Aug 11 06:43:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-7369e924-c8da-4ba5-aa1f-2b2559fe912b req-72beb7cb-c428-4a9b-885b-914bff124bb7 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-7369e924-c8da-4ba5-aa1f-2b2559fe912b req-72beb7cb-c428-4a9b-885b-914bff124bb7 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-7369e924-c8da-4ba5-aa1f-2b2559fe912b req-72beb7cb-c428-4a9b-885b-914bff124bb7 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-7369e924-c8da-4ba5-aa1f-2b2559fe912b req-72beb7cb-c428-4a9b-885b-914bff124bb7 tempest-AttachVolumeNegativeTest-40958079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-44e45039-f455-424b-9686-d61bbe284c28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53213e3d-b819-4835-8c8c-c86697f8cc71', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:43:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-7369e924-c8da-4ba5-aa1f-2b2559fe912b req-72beb7cb-c428-4a9b-885b-914bff124bb7 tempest-AttachVolumeNegativeTest-40958079 None] attachment_update completed successfully. Aug 11 06:43:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-316fd304-c6ba-46ec-9282-298fb8b01926 req-701e36c7-37f0-45c8-b0e8-9a72255062c0 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-316fd304-c6ba-46ec-9282-298fb8b01926 req-701e36c7-37f0-45c8-b0e8-9a72255062c0 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-8fc105ef-f608-4114-9636-a475783d58ba req-54592bdc-e4ba-4c47-9bfd-f3d67f899919 tempest-AttachVolumeNegativeTest-40958079 None] Terminate volume connection completed successfully. Aug 11 06:43:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-8fc105ef-f608-4114-9636-a475783d58ba req-54592bdc-e4ba-4c47-9bfd-f3d67f899919 tempest-AttachVolumeNegativeTest-40958079 None] Deleting attachment 53213e3d-b819-4835-8c8c-c86697f8cc71. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:43:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-316fd304-c6ba-46ec-9282-298fb8b01926 req-701e36c7-37f0-45c8-b0e8-9a72255062c0 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-316fd304-c6ba-46ec-9282-298fb8b01926 req-701e36c7-37f0-45c8-b0e8-9a72255062c0 tempest-TestInstancesWithCinderVolumes-1816519480 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-8438ea73-63bb-465d-ab89-00f19a9290f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d2f2700-dbb5-4100-a39b-e48a7d1411c8', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:43:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-316fd304-c6ba-46ec-9282-298fb8b01926 req-701e36c7-37f0-45c8-b0e8-9a72255062c0 tempest-TestInstancesWithCinderVolumes-1816519480 None] attachment_update completed successfully. Aug 11 06:43:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-cb04e31c-c51a-4cfd-9da6-426b908e041f req-c0d669a0-be95-44b3-a961-c5340023435d tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-cb04e31c-c51a-4cfd-9da6-426b908e041f req-c0d669a0-be95-44b3-a961-c5340023435d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-cb04e31c-c51a-4cfd-9da6-426b908e041f req-c0d669a0-be95-44b3-a961-c5340023435d tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-cb04e31c-c51a-4cfd-9da6-426b908e041f req-c0d669a0-be95-44b3-a961-c5340023435d tempest-TestInstancesWithCinderVolumes-1816519480 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22c6742d-650d-4580-9f6a-d03afad64be0', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:43:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-cb04e31c-c51a-4cfd-9da6-426b908e041f req-c0d669a0-be95-44b3-a961-c5340023435d tempest-TestInstancesWithCinderVolumes-1816519480 None] attachment_update completed successfully. Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-44e45039-f455-424b-9686-d61bbe284c28-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-44e45039-f455-424b-9686-d61bbe284c28-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-quobyte-44e45039-f455-424b-9686-d61bbe284c28" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-44e45039-f455-424b-9686-d61bbe284c28" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498f1e7-fe14-4319-b7b2-71243adfdabe]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:47 devstack sudo[110723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 Aug 11 06:43:47 devstack sudo[110723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:47 devstack sudo[110723]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28" returned: 0 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:47 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28 Aug 11 06:43:47 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:48 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44e45039-f455-424b-9686-d61bbe284c28" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-44e45039-f455-424b-9686-d61bbe284c28" released by "delete_volume" :: held 0.701s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Created reservations ['79926f52-e37a-4e32-9645-71d7c3433553', '61c287a5-a1c6-4a01-a92a-e32a07bca7f1', '478a9fae-d8c2-4266-8006-971c149b9b51', 'b8094ae3-128a-4982-ac14-806071bc679d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:48 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:48 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:48 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Deleted volume successfully. Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c1e09b34-8100-436b-b673-d4343dfec313 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-44e45039-f455-424b-9686-d61bbe284c28-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-d2a4172c-93e7-42be-86ef-8e0ec1d74049-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-d2a4172c-93e7-42be-86ef-8e0ec1d74049-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-quobyte-d2a4172c-93e7-42be-86ef-8e0ec1d74049" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-d2a4172c-93e7-42be-86ef-8e0ec1d74049" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083fa0d-31b1-4ecc-9977-2029c19d89b7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:48 devstack sudo[110738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 Aug 11 06:43:48 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:49 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:49 devstack sudo[110744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049 Aug 11 06:43:49 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:49 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d2a4172c-93e7-42be-86ef-8e0ec1d74049" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-d2a4172c-93e7-42be-86ef-8e0ec1d74049" released by "delete_volume" :: held 0.689s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Created reservations ['3c6a8822-b91a-4d41-a540-20e6283890ee', '687ac74b-32ab-43fc-b4c7-9acd5c71f1ff', '0a328c93-bf5e-4f90-8521-4e4703dae7b7', '1f3ecc90-3cb2-49cc-9d90-11ec4affb74a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:49 devstack sudo[110751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:49 devstack sudo[110751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:49 devstack sudo[110751]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.255s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Deleted volume successfully. Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f14425c-17c7-4105-8efe-6c4e3a0bba19 tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-d2a4172c-93e7-42be-86ef-8e0ec1d74049-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-95fe65b9-1fd7-42de-b03b-92e654cff4f4-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-95fe65b9-1fd7-42de-b03b-92e654cff4f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "cinder-quobyte-95fe65b9-1fd7-42de-b03b-92e654cff4f4" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-95fe65b9-1fd7-42de-b03b-92e654cff4f4" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f3c21-ef9c-49cd-b305-b290e9edd0ed]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:50 devstack sudo[110765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 Aug 11 06:43:50 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:50 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4" returned: 0 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:50 devstack sudo[110776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4 Aug 11 06:43:50 devstack sudo[110776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:50 devstack sudo[110776]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-95fe65b9-1fd7-42de-b03b-92e654cff4f4" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-quobyte-95fe65b9-1fd7-42de-b03b-92e654cff4f4" released by "delete_volume" :: held 0.681s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Created reservations ['572eda9d-05a7-4d46-8fc3-91734cfb8466', 'f15bddf0-b988-4676-b920-378c495bef24', '3eed82c7-20b8-4cf5-9caa-3f00ed0e5c6f', '2a4c5ba1-dda5-4199-9c2e-57ad74755c48'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:50 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:50 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:51 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:51 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Deleted volume successfully. Aug 11 06:43:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72f2ec9d-738f-4083-b483-80b5c6e1776e tempest-AttachVolumeNegativeTest-40958079 None] Lock "cinder-95fe65b9-1fd7-42de-b03b-92e654cff4f4-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-be32012c-4986-45c3-9e66-d1de99721ade req-da7a26ed-6aee-492f-9ad9-dda744115d4c tempest-TestInstancesWithCinderVolumes-1816519480 None] Terminate volume connection completed successfully. Aug 11 06:43:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-be32012c-4986-45c3-9e66-d1de99721ade req-da7a26ed-6aee-492f-9ad9-dda744115d4c tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleting attachment 6d2f2700-dbb5-4100-a39b-e48a7d1411c8. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:43:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-8438ea73-63bb-465d-ab89-00f19a9290f8-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8438ea73-63bb-465d-ab89-00f19a9290f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-quobyte-8438ea73-63bb-465d-ab89-00f19a9290f8" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8438ea73-63bb-465d-ab89-00f19a9290f8" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa62d9-c723-4f9b-ab1d-b3ce1f485b06]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:52 devstack sudo[110793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 Aug 11 06:43:52 devstack sudo[110793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:52 devstack sudo[110793]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8" returned: 0 in 0.461s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:52 devstack sudo[110800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8 Aug 11 06:43:52 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:52 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8438ea73-63bb-465d-ab89-00f19a9290f8" returned: 0 in 0.342s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8438ea73-63bb-465d-ab89-00f19a9290f8" released by "delete_volume" :: held 0.843s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:52 devstack cinder-volume[94463]: WARNING cinder.quota [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-918688816-1889961985 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-918688816-1889961985, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:43:52 devstack cinder-volume[94463]: WARNING cinder.quota [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-918688816-1889961985 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-918688816-1889961985, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:43:52 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Created reservations ['a5614d67-b907-4163-ae05-737276df8230', 'bba39fa1-be76-4445-81cc-8582b50b71d8', '8922b650-c6d7-4ea4-8208-b9109006c0e0', 'a68b7d42-1600-4517-8bbd-4d96fbbac155'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:53 devstack sudo[110804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:53 devstack sudo[110804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:53 devstack sudo[110804]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleted volume successfully. Aug 11 06:43:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d25208dd-6dc8-43a8-9c5c-8558b6801486 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8438ea73-63bb-465d-ab89-00f19a9290f8-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-3ac4f74c-907a-4277-84b4-d25380b22732 req-63f3ea9a-3a0e-4316-82db-d1a735890f17 tempest-TestInstancesWithCinderVolumes-1816519480 None] Terminate volume connection completed successfully. Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-3ac4f74c-907a-4277-84b4-d25380b22732 req-63f3ea9a-3a0e-4316-82db-d1a735890f17 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleting attachment 22c6742d-650d-4580-9f6a-d03afad64be0. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-quobyte-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0e3a6c-0fc0-48dd-aad8-8543beb0fe0f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:43:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:57 devstack sudo[110834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 Aug 11 06:43:57 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:57 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:57 devstack sudo[110840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2 Aug 11 06:43:57 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:57 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2" released by "delete_volume" :: held 0.741s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:57 devstack cinder-volume[94463]: WARNING cinder.quota [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1576457048-562650488 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1576457048-562650488, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:43:57 devstack cinder-volume[94463]: WARNING cinder.quota [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1576457048-562650488 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1576457048-562650488, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Created reservations ['e2ff5d43-5da2-45a3-a8b1-4058e181104c', 'b1d85c9e-d4cd-47f2-92e8-a8e3ddcb96a5', 'f8f6ae11-2642-4070-9e91-c37df170b0b4', 'd09b70be-72f4-4de1-9c46-9cd64e86504f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:57 devstack sudo[110843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:43:57 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:43:58 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root Aug 11 06:43:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:43:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:43:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleted volume successfully. Aug 11 06:43:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-765bc9c5-cad6-4273-80ca-59c66cd49627 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8b539bd4-ca81-4383-ac25-cfebfe7c4bd2-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (4d997772-0019-4944-be75-3f419cca84bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f75170-4de8-4bc0-b499-b8f791c8352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f75170-4de8-4bc0-b499-b8f791c8352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683403944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabcf211-8fa3-40e2-9dd4-45fecbd3adbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:00Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c65c06-7eff-40a5-8176-2d60c977914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c65c06-7eff-40a5-8176-2d60c977914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4769f3-735d-4450-996e-e9674e7640ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4769f3-735d-4450-996e-e9674e7640ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabcf211-8fa3-40e2-9dd4-45fecbd3adbe', 'volume_name': 'volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357a9c0-0d08-420e-aa53-1ee6e2893138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d357a9c0-0d08-420e-aa53-1ee6e2893138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7189d9db-3c87-4773-8e8a-bf623de1ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:43:59 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Volume dabcf211-8fa3-40e2-9dd4-45fecbd3adbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe', 'volume_size': 1} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683403944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabcf211-8fa3-40e2-9dd4-45fecbd3adbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:00Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Creating volume dabcf211-8fa3-40e2-9dd4-45fecbd3adbe {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:43:59 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:43:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:43:59 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe 1073741824 Aug 11 06:43:59 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:00 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe 1073741824" returned: 0 in 0.560s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:00 devstack sudo[110870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe Aug 11 06:44:00 devstack sudo[110870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:00 devstack sudo[110870]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7189d9db-3c87-4773-8e8a-bf623de1ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d34f278-b707-413c-829c-9d37bce7b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Volume volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe (dabcf211-8fa3-40e2-9dd4-45fecbd3adbe): created successfully Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d34f278-b707-413c-829c-9d37bce7b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (4d997772-0019-4944-be75-3f419cca84bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1e6e03a5-b500-4a8e-a07a-d318f72c3c8f tempest-VolumesTestJSON-1619317627 None] Created volume successfully. Aug 11 06:44:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-51380262-0b21-4172-9a65-6789adc11423 req-d2cf720e-e6ed-4411-bf5d-8b9ea83b3d77 tempest-TestInstancesWithCinderVolumes-1816519480 None] Terminate volume connection completed successfully. Aug 11 06:44:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-51380262-0b21-4172-9a65-6789adc11423 req-d2cf720e-e6ed-4411-bf5d-8b9ea83b3d77 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleting attachment 70e17100-bbb6-42a8-a2bb-7458b58c3c05. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (50b973ec-8109-41ba-b3b5-7f2a953d69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556acbac-e015-46cc-976e-6c937347ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556acbac-e015-46cc-976e-6c937347ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1921552806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b381ee9-b1c1-4f40-a98e-7e8265986774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:02Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48b3c5a-9335-451f-8a01-ef6d5beae353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c48b3c5a-9335-451f-8a01-ef6d5beae353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0fa8c3-8822-4cfc-9233-9c3ff9ccfc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0fa8c3-8822-4cfc-9233-9c3ff9ccfc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b381ee9-b1c1-4f40-a98e-7e8265986774', 'volume_name': 'volume-0b381ee9-b1c1-4f40-a98e-7e8265986774', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7037c134-85b4-447b-8119-eb6ba5f0fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7037c134-85b4-447b-8119-eb6ba5f0fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c663ba9-c042-4165-9dab-97b5e290ffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:02 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Volume 0b381ee9-b1c1-4f40-a98e-7e8265986774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b381ee9-b1c1-4f40-a98e-7e8265986774', 'volume_size': 1} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1921552806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b381ee9-b1c1-4f40-a98e-7e8265986774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:02Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Creating volume 0b381ee9-b1c1-4f40-a98e-7e8265986774 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:44:02 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:02 devstack sudo[110886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 1073741824 Aug 11 06:44:02 devstack sudo[110886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-8b352dcb-d090-4beb-8762-9b4b72b7666b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8b352dcb-d090-4beb-8762-9b4b72b7666b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "cinder-quobyte-8b352dcb-d090-4beb-8762-9b4b72b7666b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8b352dcb-d090-4beb-8762-9b4b72b7666b" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d931e0b-e618-4090-b1cc-e3ff7d6b36f1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:02 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b Aug 11 06:44:02 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:02 devstack sudo[110886]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 1073741824" returned: 0 in 0.486s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:02 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:02 devstack sudo[110898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 Aug 11 06:44:02 devstack sudo[110898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:02 devstack sudo[110900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b Aug 11 06:44:02 devstack sudo[110900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:03 devstack sudo[110898]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774" returned: 0 in 0.244s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c663ba9-c042-4165-9dab-97b5e290ffb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b381ee9-b1c1-4f40-a98e-7e8265986774', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c80b143-e571-461c-ba5c-25e3d4e7cbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Volume volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 (0b381ee9-b1c1-4f40-a98e-7e8265986774): created successfully Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c80b143-e571-461c-ba5c-25e3d4e7cbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (50b973ec-8109-41ba-b3b5-7f2a953d69c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:03 devstack sudo[110900]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-be0cd809-c1bd-4078-9d46-9ceaa8c449d6 tempest-VolumesTestJSON-1619317627 None] Created volume successfully. Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b352dcb-d090-4beb-8762-9b4b72b7666b" returned: 0 in 0.296s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-quobyte-8b352dcb-d090-4beb-8762-9b4b72b7666b" released by "delete_volume" :: held 0.739s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:03 devstack cinder-volume[94463]: WARNING cinder.quota [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-287351650-72429291 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-287351650-72429291, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:03 devstack cinder-volume[94463]: WARNING cinder.quota [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-287351650-72429291 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-287351650-72429291, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Created reservations ['9883703a-2dda-428f-8aff-fab29da9c37f', '9ccbf07a-4624-446f-a807-c476a5d7dbcc', 'b3cc5965-e9f3-4be6-af0f-46a773411e4b', '61d44ae8-d3be-456e-9c20-2b2db74cdb59'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:03 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:03 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:03 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.263s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Deleted volume successfully. Aug 11 06:44:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2579e5bb-23f5-498d-ac25-8b3873fa2b88 tempest-TestInstancesWithCinderVolumes-1816519480 None] Lock "cinder-8b352dcb-d090-4beb-8762-9b4b72b7666b-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (60fb7485-3299-4711-a0c5-5471cd963f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bd858a-0dbf-40d2-a5aa-d6737731fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00bd858a-0dbf-40d2-a5aa-d6737731fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1410258364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2692edc6-1867-45a6-8ae0-7e5722375ce4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:05Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e94ffa-2202-4818-ae61-1449798fb413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e94ffa-2202-4818-ae61-1449798fb413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe7f048-f25e-4b35-9545-e36a026cdb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe7f048-f25e-4b35-9545-e36a026cdb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2692edc6-1867-45a6-8ae0-7e5722375ce4', 'volume_name': 'volume-2692edc6-1867-45a6-8ae0-7e5722375ce4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d7c875-306e-4770-9d26-255958d29f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d7c875-306e-4770-9d26-255958d29f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd744f-8cdf-44ce-b831-86f39da320cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Volume 2692edc6-1867-45a6-8ae0-7e5722375ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2692edc6-1867-45a6-8ae0-7e5722375ce4', 'volume_size': 1} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1410258364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2692edc6-1867-45a6-8ae0-7e5722375ce4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ed68871333c4925a57d623cf4e168c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:05Z,use_quota=True,user_id='24883d1da3d74e0ca3da355c8deb53b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Creating volume 2692edc6-1867-45a6-8ae0-7e5722375ce4 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:44:04 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:44:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:04 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 1073741824 Aug 11 06:44:04 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:05 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 1073741824" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:05 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 Aug 11 06:44:05 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:05 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd744f-8cdf-44ce-b831-86f39da320cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2692edc6-1867-45a6-8ae0-7e5722375ce4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd1b2d-3c22-4dbc-97ce-caf4025a1ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:05 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Volume volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 (2692edc6-1867-45a6-8ae0-7e5722375ce4): created successfully Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd1b2d-3c22-4dbc-97ce-caf4025a1ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Flow 'volume_create_manager' (60fb7485-3299-4711-a0c5-5471cd963f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-482442b7-badc-4e8b-a1b5-303adefe050c tempest-VolumesTestJSON-1619317627 None] Created volume successfully. Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-2692edc6-1867-45a6-8ae0-7e5722375ce4-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-2692edc6-1867-45a6-8ae0-7e5722375ce4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-quobyte-2692edc6-1867-45a6-8ae0-7e5722375ce4" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-2692edc6-1867-45a6-8ae0-7e5722375ce4" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e557205a-9cfb-4d6f-ac90-03a34679e41b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:06 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 Aug 11 06:44:06 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:07 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4" returned: 0 in 0.333s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:07 devstack sudo[110922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4 Aug 11 06:44:07 devstack sudo[110922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:07 devstack sudo[110922]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2692edc6-1867-45a6-8ae0-7e5722375ce4" returned: 0 in 0.235s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-2692edc6-1867-45a6-8ae0-7e5722375ce4" released by "delete_volume" :: held 0.605s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Created reservations ['1cab5858-ef68-4bbb-8d07-921c5aaf7a6d', '5d5af409-9ee4-414e-86cb-530b4ec6efc0', '9c043ac9-7300-4f1a-a623-db68084619e7', '2d67492d-9b14-4ef6-a9df-8e130214ced7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:07 devstack sudo[110925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:07 devstack sudo[110925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:07 devstack sudo[110925]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Deleted volume successfully. Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-66f031f1-7b61-4762-be15-5c11d59794c7 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-2692edc6-1867-45a6-8ae0-7e5722375ce4-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-0b381ee9-b1c1-4f40-a98e-7e8265986774-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-0b381ee9-b1c1-4f40-a98e-7e8265986774-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-quobyte-0b381ee9-b1c1-4f40-a98e-7e8265986774" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-0b381ee9-b1c1-4f40-a98e-7e8265986774" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[78888853-0a22-4002-ada7-99c62ba3e925]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:08 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 Aug 11 06:44:08 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:08 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774" returned: 0 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:08 devstack sudo[110935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774 Aug 11 06:44:08 devstack sudo[110935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:08 devstack sudo[110935]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0b381ee9-b1c1-4f40-a98e-7e8265986774" returned: 0 in 0.334s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-0b381ee9-b1c1-4f40-a98e-7e8265986774" released by "delete_volume" :: held 0.806s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Created reservations ['54652db0-4e69-49c4-bb25-83c4c50188f5', '9f9f0b08-94bd-403e-bbb4-12f5b2e5f98f', '70c73e27-3539-40d8-8b0d-3a0ee76ebaf0', '1d19d501-6935-4e59-871d-b9305bc1db14'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:08 devstack sudo[110939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:08 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "cinder-quobyte-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6072e28a-422e-4046-8a13-a9bd696b91ca]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:09 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.336s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Deleted volume successfully. Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b7bc3572-5fd1-47ae-90ee-157f3416f991 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-0b381ee9-b1c1-4f40-a98e-7e8265986774-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:09 devstack sudo[110942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe Aug 11 06:44:09 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:09 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" returned: 0 in 0.418s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:09 devstack sudo[110947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe Aug 11 06:44:09 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:09 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" returned: 0 in 0.287s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-quobyte-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe" released by "delete_volume" :: held 0.750s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Created reservations ['0547416a-1b7d-4848-842e-c4cc173cfdb6', '65e9f67b-6e4e-4cf2-9822-8c6bf8611aea', 'c4779192-6f73-4d44-8af5-f37b1a47364b', 'c853d29e-43ad-4ce2-b552-37486b48270d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:10 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:10 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:10 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.276s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Deleted volume successfully. Aug 11 06:44:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-af7016b5-3c44-4778-86be-f64e63390427 tempest-VolumesTestJSON-1619317627 None] Lock "cinder-dabcf211-8fa3-40e2-9dd4-45fecbd3adbe-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:15 devstack sudo[110956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:15 devstack sudo[110956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:15 devstack sudo[110956]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:44:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:44:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4b5cca81-0412-4e88-bc2e-880d22e1be9d tempest-BackendsCapabilitiesAdminTestsJSON-1874603401 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94463) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 06:44:18 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bb7e8421-b72b-4b3e-b66f-c4deff4245a3 tempest-BackendsCapabilitiesAdminTestsJSON-1874603401 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94463) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 06:44:20 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=71,cinder:UPDATE=89,cinder:INSERT=19,cinder:DELETE=3 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:44:20 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=83,cinder:UPDATE=89,cinder:INSERT=21,cinder:DELETE=10 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:44:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-504d784b-5d29-4b4b-9d5e-282748a6e902 tempest-GroupSnapshotsV319Test-275279796 None] Group tempest-GroupSnapshotsV319Test-Group-1144040620: creating Aug 11 06:44:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-504d784b-5d29-4b4b-9d5e-282748a6e902 tempest-GroupSnapshotsV319Test-275279796 None] Group tempest-GroupSnapshotsV319Test-Group-1144040620: created successfully Aug 11 06:44:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-504d784b-5d29-4b4b-9d5e-282748a6e902 tempest-GroupSnapshotsV319Test-275279796 None] Create group completed successfully. Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Flow 'volume_create_manager' (c942fa3f-d65d-4839-b74b-a3ed8de877ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c745104-7636-48df-b8b1-7bda9639ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c745104-7636-48df-b8b1-7bda9639ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006900135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f454ab-d068-4607-b213-f90536e974e2,host='devstack@QuobyteHD#QuobyteHD',id=ae73b239-4bda-4c05-930b-9b8142c76a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d903ccf6048f4400a1ebab5e92015c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:25Z,use_quota=True,user_id='5ecb842eda634fb9873c76b50fa9a0a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab002985-76dd-408b-a696-60bce9122f3b),volume_type_id=ab002985-76dd-408b-a696-60bce9122f3b)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0889c-780b-4b51-ade9-d4ea2eb3a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c0889c-780b-4b51-ade9-d4ea2eb3a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc4edd-c8af-4539-8515-c6e995614703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc4edd-c8af-4539-8515-c6e995614703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae73b239-4bda-4c05-930b-9b8142c76a28', 'volume_name': 'volume-ae73b239-4bda-4c05-930b-9b8142c76a28', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a5d982-a85b-4b20-adad-c37d4b02770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a5d982-a85b-4b20-adad-c37d4b02770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad95d35-1092-4189-9da2-74192b9b36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Volume ae73b239-4bda-4c05-930b-9b8142c76a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae73b239-4bda-4c05-930b-9b8142c76a28', 'volume_size': 1} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63f454ab-d068-4607-b213-f90536e974e2,created_at=2026-08-11T04:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2006900135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f454ab-d068-4607-b213-f90536e974e2,host='devstack@QuobyteHD#QuobyteHD',id=ae73b239-4bda-4c05-930b-9b8142c76a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d903ccf6048f4400a1ebab5e92015c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:25Z,use_quota=True,user_id='5ecb842eda634fb9873c76b50fa9a0a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab002985-76dd-408b-a696-60bce9122f3b),volume_type_id=ab002985-76dd-408b-a696-60bce9122f3b)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Creating volume ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:44:25 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:25 devstack sudo[111002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 1073741824 Aug 11 06:44:25 devstack sudo[111002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:25 devstack sudo[111002]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 1073741824" returned: 0 in 0.450s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:25 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 Aug 11 06:44:25 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:26 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28" returned: 0 in 0.265s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad95d35-1092-4189-9da2-74192b9b36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae73b239-4bda-4c05-930b-9b8142c76a28', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d81f440-7cdd-464f-a543-87e9c776bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Volume volume-ae73b239-4bda-4c05-930b-9b8142c76a28 (ae73b239-4bda-4c05-930b-9b8142c76a28): created successfully Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d81f440-7cdd-464f-a543-87e9c776bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Flow 'volume_create_manager' (c942fa3f-d65d-4839-b74b-a3ed8de877ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5f4e346c-2951-4e4e-b3ea-1752a93a43b5 tempest-GroupSnapshotsV319Test-275279796 None] Created volume successfully. Aug 11 06:44:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] GroupSnapshot 83dac32f-1588-44ec-8573-288b5f969aa9: creating. Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Group snapshot 83dac32f-1588-44ec-8573-288b5f969aa9: creating. {{(pid=94463) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Creating offline snapshot dc1f3b56-9cad-49b3-97ec-00442617c62e of volume ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708f5f6-f6ee-42ed-a6e8-9e07a52848bb]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:26 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 Aug 11 06:44:26 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:27 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:27 devstack sudo[111016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e 1G Aug 11 06:44:27 devstack sudo[111016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:27 devstack sudo[111016]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e 1G" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae73b239-4bda-4c05-930b-9b8142c76a28 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:27 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae73b239-4bda-4c05-930b-9b8142c76a28 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e Aug 11 06:44:27 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:28 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae73b239-4bda-4c05-930b-9b8142c76a28 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e" returned: 0 in 0.342s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:28 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:28 devstack sudo[111027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e Aug 11 06:44:28 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:28 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:28 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info Aug 11 06:44:28 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:28 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:28 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:28 devstack sudo[111033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info Aug 11 06:44:28 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:28 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.info" returned: 0 in 0.276s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.245s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3c2e8315-2f87-49cc-ba2c-516565e10d56 tempest-GroupSnapshotsV319Test-275279796 None] group_snapshot 83dac32f-1588-44ec-8573-288b5f969aa9: created successfully Aug 11 06:44:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] group_snapshot 83dac32f-1588-44ec-8573-288b5f969aa9: deleting Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] group_snapshot 83dac32f-1588-44ec-8573-288b5f969aa9: deleting {{(pid=94463) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "cinder-quobyte-dc1f3b56-9cad-49b3-97ec-00442617c62e" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-dc1f3b56-9cad-49b3-97ec-00442617c62e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Deleting offline snapshot dc1f3b56-9cad-49b3-97ec-00442617c62e of volume ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] snapshot_file for this snap is: volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb3d68f-79a9-4681-9abc-2ce56b1a78e7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:30 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e Aug 11 06:44:30 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:30 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e" returned: 0 in 0.454s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae73b239-4bda-4c05-930b-9b8142c76a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce445192-1474-41ba-8088-cb5c345f8e72]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:31 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 Aug 11 06:44:31 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:31 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:31 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e Aug 11 06:44:31 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:31 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e" returned: 0 in 0.371s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:31 devstack sudo[111054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e Aug 11 06:44:31 devstack sudo[111054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:32 devstack sudo[111054]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28.dc1f3b56-9cad-49b3-97ec-00442617c62e" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-dc1f3b56-9cad-49b3-97ec-00442617c62e" released by "_delete_snapshot" :: held 1.619s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" released by "delete_snapshot" :: held 1.646s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:32 devstack cinder-volume[94463]: WARNING cinder.quota [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-766251787 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-766251787, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:32 devstack cinder-volume[94463]: WARNING cinder.quota [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-766251787 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-766251787, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] Created reservations ['50191ba4-31f3-4ea5-b918-fcd6e59c8e89', 'c56da448-c64a-44b1-a605-683fa5e52cbf', '3348ec17-22fc-4d9a-b773-ec05e014d20d', 'ee88cda1-78ee-4224-a3bf-03c846c57228'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fa41e562-af3d-4d2f-bfd9-ae9174e82688 tempest-GroupSnapshotsV319Test-275279796 None] group_snapshot 83dac32f-1588-44ec-8573-288b5f969aa9: deleted successfully Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe31408-c4a1-43c6-8fd1-4eab2c263100]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:33 devstack sudo[111057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 Aug 11 06:44:33 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:33 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28" returned: 0 in 0.404s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:33 devstack sudo[111062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28 Aug 11 06:44:33 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:33 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ae73b239-4bda-4c05-930b-9b8142c76a28" returned: 0 in 0.304s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Lock "cinder-quobyte-ae73b239-4bda-4c05-930b-9b8142c76a28" released by "delete_volume" :: held 0.792s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Created reservations ['7620471b-4452-48df-b1f8-0df7c1acc612'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:33 devstack cinder-volume[94463]: WARNING cinder.quota [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-766251787 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-766251787, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:33 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Created reservations ['3415e161-4762-4b5d-9275-cf6083d73d2a', 'aec3401e-b849-45af-ad34-d191db474f2d', 'cd3190af-08a8-4732-812b-3f053c0c4f7c', '15b0cf29-21ff-4456-b245-fde75213623f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:34 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:34 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:34 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.323s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:34 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a418b526-6d6e-4088-aace-53d26137f9d1 tempest-GroupSnapshotsV319Test-275279796 None] Delete group completed successfully. Aug 11 06:44:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-186ad89d-424f-4437-acb4-a13a216842e0 tempest-GroupsV314Test-1114331865 None] Group tempest-GroupsV314Test-Group-1627150486: creating Aug 11 06:44:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-186ad89d-424f-4437-acb4-a13a216842e0 tempest-GroupsV314Test-1114331865 None] Group tempest-GroupsV314Test-Group-1627150486: created successfully Aug 11 06:44:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-186ad89d-424f-4437-acb4-a13a216842e0 tempest-GroupsV314Test-1114331865 None] Create group completed successfully. Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Flow 'volume_create_manager' (04003761-9181-486a-8c34-f3975386f333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a46ae6d-c0e6-4116-bbfb-c59700f07829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a46ae6d-c0e6-4116-bbfb-c59700f07829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724476054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba9b66b6-60f7-42cd-928f-c1b3edccd6c6,host='devstack@QuobyteHD#QuobyteHD',id=5100f572-9b11-4c32-b6a6-cadf7e20d836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc3fab926d74c60b49885898828f327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:41Z,use_quota=True,user_id='13aa33f3066f4cdd94499cc6a7b6e225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2a99d40-9db4-44e5-a689-99f1abdcdc81),volume_type_id=c2a99d40-9db4-44e5-a689-99f1abdcdc81)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84327745-2bf7-437d-8fc6-5142bad81cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84327745-2bf7-437d-8fc6-5142bad81cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d85a08-ce04-4254-bdd8-fd470666127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d85a08-ce04-4254-bdd8-fd470666127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5100f572-9b11-4c32-b6a6-cadf7e20d836', 'volume_name': 'volume-5100f572-9b11-4c32-b6a6-cadf7e20d836', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fb1c42-e4a9-4370-86e9-79e7398aff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49fb1c42-e4a9-4370-86e9-79e7398aff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bf7882-d5ca-4138-99f3-a21bfbfbb70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Volume 5100f572-9b11-4c32-b6a6-cadf7e20d836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5100f572-9b11-4c32-b6a6-cadf7e20d836', 'volume_size': 1} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba9b66b6-60f7-42cd-928f-c1b3edccd6c6,created_at=2026-08-11T04:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-724476054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba9b66b6-60f7-42cd-928f-c1b3edccd6c6,host='devstack@QuobyteHD#QuobyteHD',id=5100f572-9b11-4c32-b6a6-cadf7e20d836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc3fab926d74c60b49885898828f327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:44:41Z,use_quota=True,user_id='13aa33f3066f4cdd94499cc6a7b6e225',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2a99d40-9db4-44e5-a689-99f1abdcdc81),volume_type_id=c2a99d40-9db4-44e5-a689-99f1abdcdc81)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Creating volume 5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:44:41 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:41 devstack sudo[111074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 1073741824 Aug 11 06:44:41 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:41 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 1073741824" returned: 0 in 0.456s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:41 devstack sudo[111080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:41 devstack sudo[111080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:42 devstack sudo[111080]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68bf7882-d5ca-4138-99f3-a21bfbfbb70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5100f572-9b11-4c32-b6a6-cadf7e20d836', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3b63e9-73d8-4983-906c-1f242dbc2c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:44:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Volume volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 (5100f572-9b11-4c32-b6a6-cadf7e20d836): created successfully Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3b63e9-73d8-4983-906c-1f242dbc2c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:44:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Flow 'volume_create_manager' (04003761-9181-486a-8c34-f3975386f333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:44:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-775f3513-f240-477e-8504-2af4b3b6929c tempest-GroupsV314Test-1114331865 None] Created volume successfully. Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:43 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Cloning volume 5100f572-9b11-4c32-b6a6-cadf7e20d836 to volume 63660a4b-8c49-431d-b9e2-ee9bd6740728 Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Creating offline snapshot 2f856387-8c80-4e84-b67d-32eac35bb84b of volume 5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efcf8c3-52d6-41eb-9ff7-ce2e298d4ee1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:43 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:43 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:43 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.526s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:43 devstack sudo[111105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b 1G Aug 11 06:44:43 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:44 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b 1G" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:44 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:44 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:44 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:44 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:44 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:44 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:44 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:44 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info Aug 11 06:44:44 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:45 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:45 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:45 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info Aug 11 06:44:45 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:45 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.info" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Acquiring lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] snapshot: 2f856387-8c80-4e84-b67d-32eac35bb84b, volume: 63660a4b-8c49-431d-b9e2-ee9bd6740728, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc47b75-b1e3-438d-9c64-946ed7b9ca82]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:45 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:45 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:46 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.613s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5100f572-9b11-4c32-b6a6-cadf7e20d836(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca705ae-47ae-4d11-88a4-b74f6e001f80]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:46 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:46 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:46 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.635s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:44:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:46 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 Aug 11 06:44:46 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:52 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728" returned: 0 in 6.089s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:52 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:44:52 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Converted 1024.00 MB image at 168.14 MB/s Aug 11 06:44:52 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 is being set with open permissions: ugo+rw: NotImplementedError Aug 11 06:44:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:52 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 Aug 11 06:44:52 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:53 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" released by "_copy_volume_from_snapshot" :: held 7.720s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Acquiring lock "cinder-quobyte-2f856387-8c80-4e84-b67d-32eac35bb84b" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-2f856387-8c80-4e84-b67d-32eac35bb84b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Deleting offline snapshot 2f856387-8c80-4e84-b67d-32eac35bb84b of volume 5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] snapshot_file for this snap is: volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f47b71-f8b5-4401-aed3-8775a8ade5bf]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:53 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:53 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:53 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.455s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5100f572-9b11-4c32-b6a6-cadf7e20d836(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb11f14-e86e-43d8-970a-832df8d99a98]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:53 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:53 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:54 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.543s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:54 devstack sudo[111261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:54 devstack sudo[111261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:54 devstack sudo[111261]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.326s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:54 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b Aug 11 06:44:54 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=35,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:44:54 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836.2f856387-8c80-4e84-b67d-32eac35bb84b" returned: 0 in 0.243s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-2f856387-8c80-4e84-b67d-32eac35bb84b" released by "_delete_snapshot" :: held 1.686s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.699s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4c36ec6e-cd67-43f0-a6c2-310aa82ff91d tempest-GroupsV314Test-1114331865 None] Create group from source-group-ba9b66b6-60f7-42cd-928f-c1b3edccd6c6 completed successfully. Aug 11 06:44:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Acquiring lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5926608-b71d-43d7-b4af-9f4aa4699aff]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:56 devstack sudo[111269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 Aug 11 06:44:56 devstack sudo[111269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:56 devstack sudo[111269]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:56 devstack sudo[111274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728 Aug 11 06:44:56 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:56 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-63660a4b-8c49-431d-b9e2-ee9bd6740728" returned: 0 in 0.254s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-63660a4b-8c49-431d-b9e2-ee9bd6740728" released by "delete_volume" :: held 0.699s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Created reservations ['b646a8a4-72a2-420f-994a-3e46cfb99f2d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:56 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1261913334 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1261913334, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:56 devstack cinder-volume[94463]: WARNING cinder.quota [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1261913334 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1261913334, it is now deprecated. Please use the default quota class for default quota. Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Created reservations ['f5c8f9d9-cadf-491b-ba8f-90e2b46f0c28', '27879d1b-51ab-4d70-8aba-048ba05d3ad7', '483b77c7-6f9c-4d03-bd41-f544ed84b430', '9c7b456b-4802-4e59-af25-fc51dde1099e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:56 devstack sudo[111277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:56 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:57 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1332cdb3-28cf-490b-89b4-94e84ea60483 tempest-GroupsV314Test-1114331865 None] Delete group completed successfully. Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Acquiring lock "cinder-quobyte-5100f572-9b11-4c32-b6a6-cadf7e20d836" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-5100f572-9b11-4c32-b6a6-cadf7e20d836" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82a230-2075-43a4-b503-7ced519181fd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:57 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:57 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:57 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:57 devstack sudo[111285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836 Aug 11 06:44:57 devstack sudo[111285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:57 devstack sudo[111285]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-5100f572-9b11-4c32-b6a6-cadf7e20d836" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Lock "cinder-quobyte-5100f572-9b11-4c32-b6a6-cadf7e20d836" released by "delete_volume" :: held 0.712s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Created reservations ['997e67ea-be8f-4f42-991d-7cb0d71bf6ce'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Created reservations ['0f556636-739a-41b6-b89a-fd75e36d3664', '9142b4ee-d5d4-4df5-ae5c-e62e1fbd8315', '80b2e2e6-1a76-4a64-9746-a6752351aaf9', '83f240cd-cae5-432d-8d68-115b70a9ecef'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:44:58 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:44:58 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:44:58 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.247s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:44:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:44:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-757ddfed-4e5a-407d-b6c6-593f9adf3230 tempest-GroupsV314Test-1114331865 None] Delete group completed successfully. Aug 11 06:45:08 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=47,cinder:UPDATE=52,cinder:INSERT=13,cinder:DELETE=1 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:45:08 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=5 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Flow 'volume_create_manager' (9354f749-a76d-41f6-a529-57cbeabc3c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f3e142-02b2-4f88-9369-37ca8defe629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f3e142-02b2-4f88-9369-37ca8defe629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-741828503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d017d4dc-709e-450e-af43-2b5e0ef11317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef9605144343d29c1c2906250eb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:09Z,use_quota=True,user_id='c0d21b55381c4a73816382325becc5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbd6331-059b-47e3-96c3-e8eddcf91121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbd6331-059b-47e3-96c3-e8eddcf91121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cada42ae-106d-47e0-aa5e-7611b2592d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cada42ae-106d-47e0-aa5e-7611b2592d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd017d4dc-709e-450e-af43-2b5e0ef11317', 'volume_name': 'volume-d017d4dc-709e-450e-af43-2b5e0ef11317', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5b6c1c-1bf8-4a02-8202-f44ed3e695b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5b6c1c-1bf8-4a02-8202-f44ed3e695b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e62b3a9-dcce-47fd-b69f-cac89976e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:09 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume d017d4dc-709e-450e-af43-2b5e0ef11317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d017d4dc-709e-450e-af43-2b5e0ef11317', 'volume_size': 1} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-741828503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d017d4dc-709e-450e-af43-2b5e0ef11317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef9605144343d29c1c2906250eb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:09Z,use_quota=True,user_id='c0d21b55381c4a73816382325becc5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Creating volume d017d4dc-709e-450e-af43-2b5e0ef11317 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:09 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:09 devstack sudo[111310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 1073741824 Aug 11 06:45:09 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:10 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 1073741824" returned: 0 in 0.472s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:10 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 Aug 11 06:45:10 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:10 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317" returned: 0 in 0.272s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e62b3a9-dcce-47fd-b69f-cac89976e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d017d4dc-709e-450e-af43-2b5e0ef11317', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff63c48-0b67-497e-8f7c-5339c04dca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:10 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume volume-d017d4dc-709e-450e-af43-2b5e0ef11317 (d017d4dc-709e-450e-af43-2b5e0ef11317): created successfully Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff63c48-0b67-497e-8f7c-5339c04dca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Flow 'volume_create_manager' (9354f749-a76d-41f6-a529-57cbeabc3c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b0a2a7e6-a93b-4787-9c4c-c2284e76b443 tempest-VolumeQuotasAdminTestJSON-578612414 None] Created volume successfully. Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "cinder-d017d4dc-709e-450e-af43-2b5e0ef11317-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "cinder-d017d4dc-709e-450e-af43-2b5e0ef11317-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "cinder-quobyte-d017d4dc-709e-450e-af43-2b5e0ef11317" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "cinder-quobyte-d017d4dc-709e-450e-af43-2b5e0ef11317" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e4e91-c3c1-46c7-977d-875a3e66633b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:11 devstack sudo[111320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 Aug 11 06:45:11 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:12 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:12 devstack sudo[111325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317 Aug 11 06:45:12 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:12 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d017d4dc-709e-450e-af43-2b5e0ef11317" returned: 0 in 0.245s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "cinder-quobyte-d017d4dc-709e-450e-af43-2b5e0ef11317" released by "delete_volume" :: held 0.622s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Created reservations ['4e0c540d-7ac5-4659-933d-82b65acdaf2b', '86b37ed8-bcaa-40a7-bb1c-e318453abea8', '269439d1-b293-4a13-8dd4-59e28461a43f', '5ba0f392-5ea9-4f77-aa69-cae99e018d00'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:12 devstack sudo[111328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:12 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:12 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Deleted volume successfully. Aug 11 06:45:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ee5f7b39-c171-49f3-88b1-2f1b41325ab0 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "cinder-d017d4dc-709e-450e-af43-2b5e0ef11317-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Flow 'volume_create_manager' (135ec865-8654-49cc-a92b-2d4b6d17e442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6675ae-f83d-4b61-ac5c-e9727c910e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6675ae-f83d-4b61-ac5c-e9727c910e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1137879005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfb0e3-919e-473c-921e-f59593776399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef9605144343d29c1c2906250eb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:13Z,use_quota=True,user_id='c0d21b55381c4a73816382325becc5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0994683-3f83-4734-8dd6-75f7efcc48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0994683-3f83-4734-8dd6-75f7efcc48ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722aa375-4f80-4880-ac64-234b80e7db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722aa375-4f80-4880-ac64-234b80e7db91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cfb0e3-919e-473c-921e-f59593776399', 'volume_name': 'volume-55cfb0e3-919e-473c-921e-f59593776399', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc95312-f083-4bb7-be74-c83397978343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc95312-f083-4bb7-be74-c83397978343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f0182-f97d-4c14-b2e5-9777c9c8f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume 55cfb0e3-919e-473c-921e-f59593776399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cfb0e3-919e-473c-921e-f59593776399', 'volume_size': 1} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1137879005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cfb0e3-919e-473c-921e-f59593776399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef9605144343d29c1c2906250eb61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:13Z,use_quota=True,user_id='c0d21b55381c4a73816382325becc5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Creating volume 55cfb0e3-919e-473c-921e-f59593776399 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:13 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:13 devstack sudo[111333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 1073741824 Aug 11 06:45:13 devstack sudo[111333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Flow 'volume_create_manager' (afa11b74-1a27-40ea-b2cc-73a2653e091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdba4db-d326-455c-bfcb-f5c9b468cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdba4db-d326-455c-bfcb-f5c9b468cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-349463763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc4018d-4be3-4ddb-ad02-6bcf7832612f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf4e801531248ff8c7e73134f36a831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:14Z,use_quota=True,user_id='bc87afa5053f4e51928f24fadd13816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd929e6-a59a-4bda-b2d3-d5b1cc6629d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd929e6-a59a-4bda-b2d3-d5b1cc6629d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbea0b81-4619-4470-b4b9-cc56023c603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbea0b81-4619-4470-b4b9-cc56023c603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc4018d-4be3-4ddb-ad02-6bcf7832612f', 'volume_name': 'volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95347cfb-0a62-4b0e-88f1-21461c338349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95347cfb-0a62-4b0e-88f1-21461c338349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7523a7-bd82-4b17-8778-a490b1d1a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Volume 1dc4018d-4be3-4ddb-ad02-6bcf7832612f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f', 'volume_size': 1} Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:13 devstack sudo[111333]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 1073741824" returned: 0 in 0.515s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:14 devstack sudo[111339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 Aug 11 06:45:14 devstack sudo[111339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:14 devstack sudo[111339]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-349463763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc4018d-4be3-4ddb-ad02-6bcf7832612f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf4e801531248ff8c7e73134f36a831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:14Z,use_quota=True,user_id='bc87afa5053f4e51928f24fadd13816f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Creating volume 1dc4018d-4be3-4ddb-ad02-6bcf7832612f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:14 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f0182-f97d-4c14-b2e5-9777c9c8f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cfb0e3-919e-473c-921e-f59593776399', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:14 devstack sudo[111342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f 1073741824 Aug 11 06:45:14 devstack sudo[111342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf02b4e-5f8b-4ee3-b8f0-081c3dac9d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Volume volume-55cfb0e3-919e-473c-921e-f59593776399 (55cfb0e3-919e-473c-921e-f59593776399): created successfully Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cf02b4e-5f8b-4ee3-b8f0-081c3dac9d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Flow 'volume_create_manager' (135ec865-8654-49cc-a92b-2d4b6d17e442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ad5c3a8f-fdef-421d-8db6-8f295bda8000 tempest-VolumeQuotasAdminTestJSON-578612414 None] Created volume successfully. Aug 11 06:45:14 devstack sudo[111342]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f 1073741824" returned: 0 in 0.406s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:14 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f Aug 11 06:45:14 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:14 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" returned: 0 in 0.242s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7523a7-bd82-4b17-8778-a490b1d1a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3e007-69a5-41db-a2b4-819d0bfda4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:15 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Volume volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f (1dc4018d-4be3-4ddb-ad02-6bcf7832612f): created successfully Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e3e007-69a5-41db-a2b4-819d0bfda4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Flow 'volume_create_manager' (afa11b74-1a27-40ea-b2cc-73a2653e091f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a7096c0f-aa85-4f0e-be42-573848416d75 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Created volume successfully. Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:15 devstack sudo[111350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:15 devstack sudo[111350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:15 devstack sudo[111350]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.236s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:45:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:45:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-30d4b9c8-8b69-4823-ba32-51582b6a6583 tempest-VolumeQuotasAdminTestJSON-1438720515 None] Transfer volume completed successfully. Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Acquiring lock "cinder-55cfb0e3-919e-473c-921e-f59593776399-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "cinder-55cfb0e3-919e-473c-921e-f59593776399-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Acquiring lock "cinder-quobyte-55cfb0e3-919e-473c-921e-f59593776399" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "cinder-quobyte-55cfb0e3-919e-473c-921e-f59593776399" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[a020fffd-15f3-4b98-827e-e2a460458a34]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:16 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 Aug 11 06:45:16 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c63a7942-f3b0-4ef1-9d19-c71525552466 req-955379f2-99ee-4df8-a259-ed771e488257 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c63a7942-f3b0-4ef1-9d19-c71525552466 req-955379f2-99ee-4df8-a259-ed771e488257 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [req-c63a7942-f3b0-4ef1-9d19-c71525552466 req-955379f2-99ee-4df8-a259-ed771e488257 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-c63a7942-f3b0-4ef1-9d19-c71525552466 req-955379f2-99ee-4df8-a259-ed771e488257 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744', 'name': 'volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7fda8d6-ab7d-4665-974d-204d984abb4d', 'enforce_multipath': True} {{(pid=94463) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 11 06:45:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-c63a7942-f3b0-4ef1-9d19-c71525552466 req-955379f2-99ee-4df8-a259-ed771e488257 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] attachment_update completed successfully. Aug 11 06:45:17 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399" returned: 0 in 0.371s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:17 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399 Aug 11 06:45:17 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:17 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-55cfb0e3-919e-473c-921e-f59593776399" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "cinder-quobyte-55cfb0e3-919e-473c-921e-f59593776399" released by "delete_volume" :: held 0.726s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Created reservations ['289fd7f8-b0f9-47e9-b309-4d620b560ed3', '21e0bdae-b753-43b5-b6a7-65206064a2fc', 'd5ab2ce7-135b-483f-9a92-5190ab7c688d', '892554d0-5472-441b-8d78-3377129e11fd'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:17 devstack sudo[111757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:17 devstack sudo[111757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:17 devstack sudo[111757]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.368s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Deleted volume successfully. Aug 11 06:45:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-888e9500-94ea-4b54-813d-50230b444568 tempest-VolumeQuotasAdminTestJSON-317131203 None] Lock "cinder-55cfb0e3-919e-473c-921e-f59593776399-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [req-b3bab955-196d-4a61-9e85-235486900887 req-eb82cf4f-2ba1-4afd-aa62-595fb68507b1 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Terminate volume connection completed successfully. Aug 11 06:45:20 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [req-b3bab955-196d-4a61-9e85-235486900887 req-eb82cf4f-2ba1-4afd-aa62-595fb68507b1 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Deleting attachment d7fda8d6-ab7d-4665-974d-204d984abb4d. {{(pid=94463) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "cinder-1dc4018d-4be3-4ddb-ad02-6bcf7832612f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "cinder-1dc4018d-4be3-4ddb-ad02-6bcf7832612f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "cinder-quobyte-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "cinder-quobyte-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c271a-f90d-43da-b30a-2cfdf23e4f36]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:21 devstack sudo[111834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f Aug 11 06:45:21 devstack sudo[111834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:21 devstack sudo[111834]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:21 devstack sudo[111839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f Aug 11 06:45:21 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:22 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" returned: 0 in 0.274s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "cinder-quobyte-1dc4018d-4be3-4ddb-ad02-6bcf7832612f" released by "delete_volume" :: held 0.719s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Created reservations ['01d82c85-99da-4a8e-ad67-4315c45d2c72', 'a93fa539-2f83-4901-b9e7-924244030558', '38d424c3-7db0-4405-9da9-0d9916764ce4', 'c6d46828-689e-4780-a906-67f75257d626'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:22 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:22 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:22 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Deleted volume successfully. Aug 11 06:45:22 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-91a71eb4-5406-4e47-bb62-1a5a5f16a5a8 tempest-TestServerVolumeAttachScenarioOldVersion-1945441240 None] Lock "cinder-1dc4018d-4be3-4ddb-ad02-6bcf7832612f-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Flow 'volume_create_manager' (28a7caa6-7353-49ca-a3dd-b301a5df3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657969a4-480f-4669-917b-410ad991cf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657969a4-480f-4669-917b-410ad991cf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-46157875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7039d1b-0a12-41e1-af60-170594266b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fda0869021f48b3a957459685478097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:26Z,use_quota=True,user_id='4a31bf14c65e4743baf16ab16d3d4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da30cbe1-07a9-4a09-a769-c9ca1c9d0bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da30cbe1-07a9-4a09-a769-c9ca1c9d0bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daaa6d3-75ae-4b61-b933-92e04989c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7daaa6d3-75ae-4b61-b933-92e04989c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7039d1b-0a12-41e1-af60-170594266b17', 'volume_name': 'volume-d7039d1b-0a12-41e1-af60-170594266b17', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab8456a-3c60-4427-a8bf-666e2ed9b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab8456a-3c60-4427-a8bf-666e2ed9b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615bb4f3-73d0-49ed-8079-b049ba87e9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Volume d7039d1b-0a12-41e1-af60-170594266b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7039d1b-0a12-41e1-af60-170594266b17', 'volume_size': 1} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-46157875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7039d1b-0a12-41e1-af60-170594266b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fda0869021f48b3a957459685478097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:26Z,use_quota=True,user_id='4a31bf14c65e4743baf16ab16d3d4cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Creating volume d7039d1b-0a12-41e1-af60-170594266b17 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:25 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:25 devstack sudo[111873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 1073741824 Aug 11 06:45:25 devstack sudo[111873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:26 devstack sudo[111873]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 1073741824" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:26 devstack sudo[111879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 Aug 11 06:45:26 devstack sudo[111879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:26 devstack sudo[111879]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17" returned: 0 in 0.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615bb4f3-73d0-49ed-8079-b049ba87e9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7039d1b-0a12-41e1-af60-170594266b17', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325826e-b6d9-4a1b-bdaf-f90bf7a2fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Volume volume-d7039d1b-0a12-41e1-af60-170594266b17 (d7039d1b-0a12-41e1-af60-170594266b17): created successfully Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a325826e-b6d9-4a1b-bdaf-f90bf7a2fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Flow 'volume_create_manager' (28a7caa6-7353-49ca-a3dd-b301a5df3765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0e462708-cb73-4c44-9a18-d09b3725b1a1 tempest-VolumesServicesTestJSON-1663864228 None] Created volume successfully. Aug 11 06:45:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Acquiring lock "cinder-d7039d1b-0a12-41e1-af60-170594266b17-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "cinder-d7039d1b-0a12-41e1-af60-170594266b17-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Acquiring lock "cinder-quobyte-d7039d1b-0a12-41e1-af60-170594266b17" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "cinder-quobyte-d7039d1b-0a12-41e1-af60-170594266b17" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c313610-cc68-404c-bebb-6c559f3d6dd3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:28 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 Aug 11 06:45:28 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:28 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:28 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17 Aug 11 06:45:28 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:28 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d7039d1b-0a12-41e1-af60-170594266b17" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "cinder-quobyte-d7039d1b-0a12-41e1-af60-170594266b17" released by "delete_volume" :: held 0.684s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Created reservations ['b06427cd-16ee-4311-bfc4-1235710bd749', 'e66dea5c-b4a8-40e0-a5d4-64c090ef3027', '32291206-54e9-4f0b-9962-528883630596', '62646351-b0f6-4481-90a5-13844b19f383'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:28 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:28 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:29 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:29 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Deleted volume successfully. Aug 11 06:45:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5dd71690-cdfd-46f0-bb78-8877c7f0b38c tempest-VolumesServicesTestJSON-1663864228 None] Lock "cinder-d7039d1b-0a12-41e1-af60-170594266b17-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=38,cinder:UPDATE=46,cinder:DELETE=5,cinder:INSERT=9 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (9a94d2e4-3a66-4210-aa1d-0c008698c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e756c0-353c-461b-b0ff-dd586fb33323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e756c0-353c-461b-b0ff-dd586fb33323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844161831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941dde93-9873-4937-b806-10a0081d9130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:39Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977c6b30-2c24-4ed0-ba76-37ebcc31d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977c6b30-2c24-4ed0-ba76-37ebcc31d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75014ee-ffa8-4e44-9de1-1045841a7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75014ee-ffa8-4e44-9de1-1045841a7a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941dde93-9873-4937-b806-10a0081d9130', 'volume_name': 'volume-941dde93-9873-4937-b806-10a0081d9130', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ee52fb-4a59-4d67-87f8-6584c09911d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ee52fb-4a59-4d67-87f8-6584c09911d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00afd64a-a13e-4317-b9e5-7b22f965f459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:38 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 941dde93-9873-4937-b806-10a0081d9130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941dde93-9873-4937-b806-10a0081d9130', 'volume_size': 1} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844161831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941dde93-9873-4937-b806-10a0081d9130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:39Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:38 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:39 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 1073741824 Aug 11 06:45:39 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:39 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 1073741824" returned: 0 in 0.453s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:39 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 Aug 11 06:45:39 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:39 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00afd64a-a13e-4317-b9e5-7b22f965f459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941dde93-9873-4937-b806-10a0081d9130', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336c4a4b-f6ea-4387-a105-bc74bf938134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-941dde93-9873-4937-b806-10a0081d9130 (941dde93-9873-4937-b806-10a0081d9130): created successfully Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336c4a4b-f6ea-4387-a105-bc74bf938134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (9a94d2e4-3a66-4210-aa1d-0c008698c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a19e018f-964b-4f2f-9b25-af676091eda0 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating offline snapshot 0ea0a14d-1eda-4db3-8106-7173cdd163f3 of volume 941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fbe359-c914-4dea-a95d-291d09a359c5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:41 devstack sudo[111911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 Aug 11 06:45:41 devstack sudo[111911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:41 devstack sudo[111911]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:41 devstack sudo[111916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 1G Aug 11 06:45:41 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:42 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 1G" returned: 0 in 0.422s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941dde93-9873-4937-b806-10a0081d9130 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:42 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941dde93-9873-4937-b806-10a0081d9130 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 Aug 11 06:45:42 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:42 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941dde93-9873-4937-b806-10a0081d9130 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3" returned: 0 in 0.333s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:42 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 is being set with open permissions: ugo+rw Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:42 devstack sudo[111927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 Aug 11 06:45:42 devstack sudo[111927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:42 devstack sudo[111927]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:42 devstack sudo[111930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info Aug 11 06:45:42 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:42 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info" returned: 0 in 0.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:42 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info is being set with open permissions: ugo+rw Aug 11 06:45:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:42 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info Aug 11 06:45:42 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:43 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.info" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e0815dc6-812c-4fa3-98dd-f685018f2e0a tempest-CreateVolumesFromSnapshotTest-1868859070 None] Create snapshot completed successfully Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Flow 'volume_create_manager' (b7841340-56f5-41f0-bda5-1c44d001ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c700f50-4fca-4391-a4f1-6d766fd221c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c700f50-4fca-4391-a4f1-6d766fd221c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1174919244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19b8f42-341b-488f-994e-4571a0f22653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cbc45b4054fb78e1fb296e185322c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='b8bd8f6e383543f3a18923b67e98decf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bd647b-2eaf-44ec-adbb-31b2f08d8e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9bd647b-2eaf-44ec-adbb-31b2f08d8e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfba9374-705c-4012-bc66-308e2d19cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfba9374-705c-4012-bc66-308e2d19cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19b8f42-341b-488f-994e-4571a0f22653', 'volume_name': 'volume-f19b8f42-341b-488f-994e-4571a0f22653', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b5682a-e5e8-42a9-98bc-c7168e677a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b5682a-e5e8-42a9-98bc-c7168e677a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0202af0-f29c-4fb1-8050-ea6eacc95388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Volume f19b8f42-341b-488f-994e-4571a0f22653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19b8f42-341b-488f-994e-4571a0f22653', 'volume_size': 1} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1174919244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19b8f42-341b-488f-994e-4571a0f22653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38cbc45b4054fb78e1fb296e185322c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='b8bd8f6e383543f3a18923b67e98decf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Creating volume f19b8f42-341b-488f-994e-4571a0f22653 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:44 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:44 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 1073741824 Aug 11 06:45:44 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (c9a3281d-60ce-48f3-92d6-856a166a90ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6a2309-f089-433c-a4f4-3f3f3de11934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6a2309-f089-433c-a4f4-3f3f3de11934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415236397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ddb582-25e5-4095-b6ab-bdfa1e8e96cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2066363-75ff-4145-9d45-1ef1ecc8b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2066363-75ff-4145-9d45-1ef1ecc8b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365e8384-7672-4334-b533-49e5df5736ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365e8384-7672-4334-b533-49e5df5736ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ddb582-25e5-4095-b6ab-bdfa1e8e96cb', 'volume_name': 'volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1bc328-b1a3-4b5f-88d6-0ce85e67a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1bc328-b1a3-4b5f-88d6-0ce85e67a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76989434-6d30-43b9-8bd9-bf4eb0d97850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 35ddb582-25e5-4095-b6ab-bdfa1e8e96cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb', 'volume_size': 1} Aug 11 06:45:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:45 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 1073741824" returned: 0 in 0.542s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (aa7ab141-8195-4c02-946a-171c05d21d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d513f783-43f6-4d9b-99bd-1ea0ba246296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d513f783-43f6-4d9b-99bd-1ea0ba246296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124141748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f220c0-155e-4e85-bc9a-cee0d2651961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77821846-311b-461e-8bab-f85f137d3336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77821846-311b-461e-8bab-f85f137d3336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64863169-888c-4523-a769-d032f071ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64863169-888c-4523-a769-d032f071ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f220c0-155e-4e85-bc9a-cee0d2651961', 'volume_name': 'volume-75f220c0-155e-4e85-bc9a-cee0d2651961', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697c8ad-5a71-48f4-8f82-a01e04764ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b697c8ad-5a71-48f4-8f82-a01e04764ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e485853b-9fe5-4a13-8a8e-0d6033ed6e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 75f220c0-155e-4e85-bc9a-cee0d2651961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f220c0-155e-4e85-bc9a-cee0d2651961', 'volume_size': 1} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:45 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 Aug 11 06:45:45 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:45 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (570cf59a-94e6-4b3f-acbd-96fe34670e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae2f998-5a8f-402b-81d2-b3d14d946d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1415236397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ddb582-25e5-4095-b6ab-bdfa1e8e96cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 35ddb582-25e5-4095-b6ab-bdfa1e8e96cb {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:45 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae2f998-5a8f-402b-81d2-b3d14d946d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534510494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4589d908-ccb9-4ed6-91c3-69541d5a5672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ebd85-77be-4a50-ac26-41e4610b22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack sudo[111945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb 1073741824 Aug 11 06:45:45 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ebd85-77be-4a50-ac26-41e4610b22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0912d15-cdcb-47e7-b4b6-6a8509b98fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0912d15-cdcb-47e7-b4b6-6a8509b98fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4589d908-ccb9-4ed6-91c3-69541d5a5672', 'volume_name': 'volume-4589d908-ccb9-4ed6-91c3-69541d5a5672', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000be859-ecb2-450d-8e3f-409c8c628643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (000be859-ecb2-450d-8e3f-409c8c628643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66509ff3-2deb-4282-86e8-2482085b6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 4589d908-ccb9-4ed6-91c3-69541d5a5672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4589d908-ccb9-4ed6-91c3-69541d5a5672', 'volume_size': 1} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0202af0-f29c-4fb1-8050-ea6eacc95388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19b8f42-341b-488f-994e-4571a0f22653', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1a6097-7ded-4d22-9c11-dfff5dc44e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Volume volume-f19b8f42-341b-488f-994e-4571a0f22653 (f19b8f42-341b-488f-994e-4571a0f22653): created successfully Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1a6097-7ded-4d22-9c11-dfff5dc44e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Flow 'volume_create_manager' (b7841340-56f5-41f0-bda5-1c44d001ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6b72c615-179d-4493-8ee3-eb914553066f tempest-VolumesMetadataTest-1897771773 None] Created volume successfully. Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (d5155bfe-100e-424b-a28d-fba6c77eb040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4612bc-b8b0-4060-91f0-7a28a4b82200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4612bc-b8b0-4060-91f0-7a28a4b82200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357464524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01971107-c299-4f8e-86e4-72dc8fdd04d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec2e268-e8b9-446b-944a-07d9272b9f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec2e268-e8b9-446b-944a-07d9272b9f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79e6705-2cfc-480e-ab1c-f00a4666eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79e6705-2cfc-480e-ab1c-f00a4666eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01971107-c299-4f8e-86e4-72dc8fdd04d0', 'volume_name': 'volume-01971107-c299-4f8e-86e4-72dc8fdd04d0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1d14c-8485-4593-a26d-feef7d33a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1db1d14c-8485-4593-a26d-feef7d33a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e14edf-27d6-489b-bae7-6090287f09b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 01971107-c299-4f8e-86e4-72dc8fdd04d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01971107-c299-4f8e-86e4-72dc8fdd04d0', 'volume_size': 1} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:46 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb 1073741824" returned: 0 in 0.561s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:46 devstack sudo[111951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb Aug 11 06:45:46 devstack sudo[111951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (2cd90b7f-19ed-41bd-88f0-f80cfb9ec692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d4bbba-137c-45cf-bc1b-22ca9cde50cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d4bbba-137c-45cf-bc1b-22ca9cde50cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664106916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6db12a-57f2-4c26-8de4-bf578de96cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40e190c-24fa-4f17-ade3-0187857a0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40e190c-24fa-4f17-ade3-0187857a0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f003d-079c-4c4e-8553-95b8cfd7408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f003d-079c-4c4e-8553-95b8cfd7408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6db12a-57f2-4c26-8de4-bf578de96cce', 'volume_name': 'volume-2c6db12a-57f2-4c26-8de4-bf578de96cce', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383725e-07f9-4e58-8871-cd02f5a241de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c383725e-07f9-4e58-8871-cd02f5a241de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ef0f1-0ef6-4e6e-8d8c-6f291cb430e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume 2c6db12a-57f2-4c26-8de4-bf578de96cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6db12a-57f2-4c26-8de4-bf578de96cce', 'volume_size': 1} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:46 devstack sudo[111951]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2124141748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f220c0-155e-4e85-bc9a-cee0d2651961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:45Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 75f220c0-155e-4e85-bc9a-cee0d2651961 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:46 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:46 devstack sudo[111954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 1073741824 Aug 11 06:45:46 devstack sudo[111954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76989434-6d30-43b9-8bd9-bf4eb0d97850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6508be3-99df-441f-8bea-bf4efdef0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb (35ddb582-25e5-4095-b6ab-bdfa1e8e96cb): created successfully Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6508be3-99df-441f-8bea-bf4efdef0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (c9a3281d-60ce-48f3-92d6-856a166a90ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-689ac58b-4c92-4e4c-8095-49f37ad67a73 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:47 devstack sudo[111954]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 1073741824" returned: 0 in 0.462s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:47 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 Aug 11 06:45:47 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:47 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534510494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4589d908-ccb9-4ed6-91c3-69541d5a5672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 4589d908-ccb9-4ed6-91c3-69541d5a5672 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:47 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e485853b-9fe5-4a13-8a8e-0d6033ed6e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f220c0-155e-4e85-bc9a-cee0d2651961', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:47 devstack sudo[111963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 1073741824 Aug 11 06:45:47 devstack sudo[111963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbceab97-b894-4a1a-893f-e18f643c791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Acquiring lock "cinder-f19b8f42-341b-488f-994e-4571a0f22653-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:47 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-75f220c0-155e-4e85-bc9a-cee0d2651961 (75f220c0-155e-4e85-bc9a-cee0d2651961): created successfully Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbceab97-b894-4a1a-893f-e18f643c791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (aa7ab141-8195-4c02-946a-171c05d21d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "cinder-f19b8f42-341b-488f-994e-4571a0f22653-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:47 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b674b669-e6bf-4cf3-befb-38baf77780e1 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Acquiring lock "cinder-quobyte-f19b8f42-341b-488f-994e-4571a0f22653" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "cinder-quobyte-f19b8f42-341b-488f-994e-4571a0f22653" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f56c93-f0f7-473d-a3e5-0c5879cec117]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:47 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 Aug 11 06:45:47 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:47 devstack sudo[111963]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 1073741824" returned: 0 in 0.481s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:47 devstack sudo[111973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 Aug 11 06:45:47 devstack sudo[111973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:47 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653" returned: 0 in 0.370s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:48 devstack sudo[111977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653 Aug 11 06:45:48 devstack sudo[111977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:48 devstack sudo[111973]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672" returned: 0 in 0.254s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-357464524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01971107-c299-4f8e-86e4-72dc8fdd04d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 01971107-c299-4f8e-86e4-72dc8fdd04d0 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:48 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66509ff3-2deb-4282-86e8-2482085b6a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4589d908-ccb9-4ed6-91c3-69541d5a5672', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966205da-6df8-4a6f-bd5b-719029d4e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:48 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 1073741824 Aug 11 06:45:48 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:48 devstack sudo[111977]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f19b8f42-341b-488f-994e-4571a0f22653" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:48 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 (4589d908-ccb9-4ed6-91c3-69541d5a5672): created successfully Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966205da-6df8-4a6f-bd5b-719029d4e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (570cf59a-94e6-4b3f-acbd-96fe34670e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "cinder-quobyte-f19b8f42-341b-488f-994e-4571a0f22653" released by "delete_volume" :: held 0.718s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-56458851-3dd6-4344-ad10-f502d8600bad tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Created reservations ['66bdfe8d-30b8-48e8-b52b-e8fef48367f9', 'a63922c6-2feb-427b-8a82-f3354e38890a', 'cec321a9-49b3-4847-aa48-c051fb5192f3', '47fd89af-7cf3-487d-80af-c962f33c220b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:48 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:48 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:48 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Deleted volume successfully. Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9bc17f39-35cc-48df-ab98-3b6009240b3d tempest-VolumesMetadataTest-1897771773 None] Lock "cinder-f19b8f42-341b-488f-994e-4571a0f22653-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:48 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 1073741824" returned: 0 in 0.582s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:48 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 Aug 11 06:45:48 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:49 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0" returned: 0 in 0.255s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664106916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6db12a-57f2-4c26-8de4-bf578de96cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee7a91cb3be0437c9303d0a09c8fb757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:46Z,use_quota=True,user_id='fcfd49292c2744e39965a9a9f4135db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Creating volume 2c6db12a-57f2-4c26-8de4-bf578de96cce {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:49 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e14edf-27d6-489b-bae7-6090287f09b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01971107-c299-4f8e-86e4-72dc8fdd04d0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:49 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce 1073741824 Aug 11 06:45:49 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47724ce1-36f6-494b-b8cc-da5c267ed0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 (01971107-c299-4f8e-86e4-72dc8fdd04d0): created successfully Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47724ce1-36f6-494b-b8cc-da5c267ed0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (d5155bfe-100e-424b-a28d-fba6c77eb040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ea1aee02-7d9c-4b38-94ae-542f211f9254 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:49 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce 1073741824" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:49 devstack sudo[111998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce Aug 11 06:45:49 devstack sudo[111998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:49 devstack sudo[111998]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ef0f1-0ef6-4e6e-8d8c-6f291cb430e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6db12a-57f2-4c26-8de4-bf578de96cce', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f554a3-6f4d-4d1d-ba2f-288a62ebbfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Volume volume-2c6db12a-57f2-4c26-8de4-bf578de96cce (2c6db12a-57f2-4c26-8de4-bf578de96cce): created successfully Aug 11 06:45:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f554a3-6f4d-4d1d-ba2f-288a62ebbfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Flow 'volume_create_manager' (2cd90b7f-19ed-41bd-88f0-f80cfb9ec692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-322c1a0b-4c8b-4c20-b953-a06dba63fc25 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created volume successfully. Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-2c6db12a-57f2-4c26-8de4-bf578de96cce-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-2c6db12a-57f2-4c26-8de4-bf578de96cce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-2c6db12a-57f2-4c26-8de4-bf578de96cce" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-2c6db12a-57f2-4c26-8de4-bf578de96cce" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6dc774-0844-48f4-a23a-5caa47799145]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:51 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce Aug 11 06:45:51 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:51 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:51 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce Aug 11 06:45:51 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:51 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2c6db12a-57f2-4c26-8de4-bf578de96cce" returned: 0 in 0.265s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-2c6db12a-57f2-4c26-8de4-bf578de96cce" released by "delete_volume" :: held 0.701s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['003c88d3-7e54-4e06-8473-e9b4a2c65eb6', '853c3c6b-dffd-41ba-945e-122b4fbe1de8', '1235cd6e-2ec8-4525-8878-49b0e773c764', '29e9330a-31f4-4e03-8a42-e115feb7579c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:51 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:51 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Flow 'volume_create_manager' (756064a3-5b36-4925-a83c-7f7608942215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e29b1c8-90e3-4d70-8fcb-f55579df97f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e29b1c8-90e3-4d70-8fcb-f55579df97f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1130978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad35b40-946e-44d1-9b73-e07002fbc709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a730a1c5ba974bd6a3900c37e0a6df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:52Z,use_quota=True,user_id='d7c5b58462f24c9c9b79d63577744667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43d0c31-6c75-43b7-8e05-afdc3a89ef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43d0c31-6c75-43b7-8e05-afdc3a89ef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bde514-ca42-4196-9a46-915e33544785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-01971107-c299-4f8e-86e4-72dc8fdd04d0-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:52 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-01971107-c299-4f8e-86e4-72dc8fdd04d0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37c5c644-42bc-4837-9f13-5f6dae30db08 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-2c6db12a-57f2-4c26-8de4-bf578de96cce-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-01971107-c299-4f8e-86e4-72dc8fdd04d0" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-01971107-c299-4f8e-86e4-72dc8fdd04d0" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f89d2e0-3650-40cb-846f-69260ef94926]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bde514-ca42-4196-9a46-915e33544785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ad35b40-946e-44d1-9b73-e07002fbc709', 'volume_name': 'volume-7ad35b40-946e-44d1-9b73-e07002fbc709', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521997a-eefc-47ea-a4c0-caff547c8b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2521997a-eefc-47ea-a4c0-caff547c8b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892b95c9-24f3-4db9-90a3-4c6e388ed464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:52 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Volume 7ad35b40-946e-44d1-9b73-e07002fbc709: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ad35b40-946e-44d1-9b73-e07002fbc709', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Trying to clone 7ad35b40-946e-44d1-9b73-e07002fbc709 from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:45:52 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 Aug 11 06:45:52 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:52 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:45:52 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Image download 20.69 MB at 20.69 MB/s Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0" returned: 0 in 0.431s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:52 devstack sudo[112021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0 Aug 11 06:45:52 devstack sudo[112021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebf9228-882b-4f66-b535-91efe7702b7a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:52 devstack sudo[112023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD Aug 11 06:45:52 devstack sudo[112023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:53 devstack sudo[112021]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-01971107-c299-4f8e-86e4-72dc8fdd04d0" returned: 0 in 0.252s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-01971107-c299-4f8e-86e4-72dc8fdd04d0" released by "delete_volume" :: held 0.726s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['73a2fa3c-cb11-4465-811b-5adc870091f6', '698a030a-2767-4dec-9acb-94862136824d', '137365c4-3fd7-478c-9d1a-a67fc8b8f8fc', 'e95442ab-6198-417c-9282-e3622a3e440d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:53 devstack sudo[112023]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 is fetched for user d7c5b58462f24c9c9b79d63577744667. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:53 devstack sudo[112029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:53 devstack sudo[112029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3cc837-ce1d-40dd-990e-24267888812e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:53 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD Aug 11 06:45:53 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-4589d908-ccb9-4ed6-91c3-69541d5a5672-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-4589d908-ccb9-4ed6-91c3-69541d5a5672-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-4589d908-ccb9-4ed6-91c3-69541d5a5672" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:53 devstack sudo[112029]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-4589d908-ccb9-4ed6-91c3-69541d5a5672" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c5196f-7336-42f9-b324-4a678016e390]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e64d178-a861-4fa8-be40-8f5b97a0c348 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-01971107-c299-4f8e-86e4-72dc8fdd04d0-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:53 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1130978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad35b40-946e-44d1-9b73-e07002fbc709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a730a1c5ba974bd6a3900c37e0a6df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:45:52Z,use_quota=True,user_id='d7c5b58462f24c9c9b79d63577744667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Creating volume 7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:45:53 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:53 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 Aug 11 06:45:53 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:53 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1073741824 Aug 11 06:45:53 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:53 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672" returned: 0 in 0.394s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:53 devstack sudo[112047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672 Aug 11 06:45:53 devstack sudo[112047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:54 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1073741824" returned: 0 in 0.501s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:54 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 Aug 11 06:45:54 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:54 devstack sudo[112047]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4589d908-ccb9-4ed6-91c3-69541d5a5672" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-4589d908-ccb9-4ed6-91c3-69541d5a5672" released by "delete_volume" :: held 0.736s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['1d21fcc2-4975-495a-9b03-0de2e2bb0971', '76db94f6-ad89-427a-9261-85768ad45ed8', '2e9cefde-8d61-4e71-9d93-44f3d634257b', '25736253-1167-45a3-8ed6-a3080a769d5b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:54 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:54 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:54 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709" returned: 0 in 0.287s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Attempting download of b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 7ad35b40-946e-44d1-9b73-e07002fbc709. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[472cf0b7-592a-47f5-a424-bfe94d79200d]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-75f220c0-155e-4e85-bc9a-cee0d2651961-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-75f220c0-155e-4e85-bc9a-cee0d2651961-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:54 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-75f220c0-155e-4e85-bc9a-cee0d2651961" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a067ef51-6f69-436d-b071-7e5b7d968d9d tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-4589d908-ccb9-4ed6-91c3-69541d5a5672-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-75f220c0-155e-4e85-bc9a-cee0d2651961" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:54 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf Aug 11 06:45:54 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5255412-8433-4b70-bb48-ad9b828fd8d0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:54 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 Aug 11 06:45:54 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:54 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack sudo[112062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf Aug 11 06:45:55 devstack sudo[112062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:55 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961" returned: 0 in 0.432s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack sudo[112067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961 Aug 11 06:45:55 devstack sudo[112067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:55 devstack sudo[112062]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf" returned: 1 in 0.360s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bfbb5e-34f5-42dc-847f-82185f2020b1_tatjczyf' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eab3e52-bf7d-4860-b3b8-5dbc9276b616]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD Aug 11 06:45:55 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:55 devstack sudo[112067]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-75f220c0-155e-4e85-bc9a-cee0d2651961" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-75f220c0-155e-4e85-bc9a-cee0d2651961" released by "delete_volume" :: held 0.805s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['6fcba719-54d4-4a83-a1c1-77a792fe90ed', 'f76c5a16-dbef-45ce-b3bb-5a60b83c5a2b', 'eafadb41-638e-4986-ae5d-672823f75c66', '1fc06c9d-3ff3-40e1-95f9-eede07608c43'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:55 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:55 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] b9bfbb5e-34f5-42dc-847f-82185f2020b1 was qcow2, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 Aug 11 06:45:55 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:55 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.292s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9908e-e12b-4482-ae05-c8bf0a2f4f8f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a68a6e48-8fc5-4d47-b7d8-73661fedef4c tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-75f220c0-155e-4e85-bc9a-cee0d2651961-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:56 devstack sudo[112084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb Aug 11 06:45:56 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:56 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" returned: 0 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:56 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb Aug 11 06:45:56 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:56 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" returned: 0 in 0.247s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb" released by "delete_volume" :: held 0.684s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['e2aac75a-0c7f-4632-ae03-4ec721c653fb', 'f6f43908-cc37-49cc-b4fb-960572ff5cdb', 'db7ab907-49c6-4d75-a361-e4a999da4cee', '3749756e-cb69-4084-9591-cc8a3655d31f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:45:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:56 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:45:56 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-0ea0a14d-1eda-4db3-8106-7173cdd163f3-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-0ea0a14d-1eda-4db3-8106-7173cdd163f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-0ea0a14d-1eda-4db3-8106-7173cdd163f3" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-0ea0a14d-1eda-4db3-8106-7173cdd163f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleting offline snapshot 0ea0a14d-1eda-4db3-8106-7173cdd163f3 of volume 941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:45:57 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] snapshot_file for this snap is: volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.325s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:45:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[385de400-d312-4c5b-b5e8-70b298406dd7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d22af018-b06a-460b-8911-fc0f3f4bf501 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-35ddb582-25e5-4095-b6ab-bdfa1e8e96cb-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:57 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 Aug 11 06:45:57 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:57 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3" returned: 0 in 0.432s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-941dde93-9873-4937-b806-10a0081d9130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395a1fd-36f4-4c6d-9359-642b1cfe4a3c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:57 devstack sudo[112107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 Aug 11 06:45:57 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:57 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709" returned: 0 in 2.041s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bfbb5e-34f5-42dc-847f-82185f2020b1_kv1_o2awdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:45:57 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Converted 112.00 MB image at 54.84 MB/s Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:57 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1G Aug 11 06:45:57 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:57 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130" returned: 0 in 0.407s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:58 devstack sudo[112114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 Aug 11 06:45:58 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:58 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 1G" returned: 0 in 0.337s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Downloaded image b9bfbb5e-34f5-42dc-847f-82185f2020b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}])) to volume 7ad35b40-946e-44d1-9b73-e07002fbc709 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Temporary image b9bfbb5e-34f5-42dc-847f-82185f2020b1 for user d7c5b58462f24c9c9b79d63577744667 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Marking volume 7ad35b40-946e-44d1-9b73-e07002fbc709 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Copying metadata from image b9bfbb5e-34f5-42dc-847f-82185f2020b1 to 7ad35b40-946e-44d1-9b73-e07002fbc709. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Creating volume glance metadata for volume 7ad35b40-946e-44d1-9b73-e07002fbc709 backed by image b9bfbb5e-34f5-42dc-847f-82185f2020b1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892b95c9-24f3-4db9-90a3-4c6e388ed464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad35b40-946e-44d1-9b73-e07002fbc709', 'volume_size': 1, 'image_id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6f3eb4d37e444a06b17c9201457ad8ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bfbb5e-34f5-42dc-847f-82185f2020b1', 'created_at': datetime.datetime(2026, 8, 11, 4, 23, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bfbb5e-34f5-42dc-847f-82185f2020b1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a108b7a-0a59-4610-9716-15d644ed4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:45:58 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Volume volume-7ad35b40-946e-44d1-9b73-e07002fbc709 (7ad35b40-946e-44d1-9b73-e07002fbc709): created successfully Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a108b7a-0a59-4610-9716-15d644ed4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Flow 'volume_create_manager' (756064a3-5b36-4925-a83c-7f7608942215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:45:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5f399200-43ad-434d-b523-6fa010afdcf4 tempest-VolumesExtendTest-14074564 None] Created volume successfully. Aug 11 06:45:58 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3" returned: 0 in 0.454s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:58 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3 Aug 11 06:45:58 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:58 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130.0ea0a14d-1eda-4db3-8106-7173cdd163f3" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-0ea0a14d-1eda-4db3-8106-7173cdd163f3" released by "_delete_snapshot" :: held 1.681s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" released by "delete_snapshot" :: held 1.709s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['8475bf2f-b7f5-4d2b-9d9f-6eaef416320f', '71ab97d5-a84b-4f71-a46a-ba5010ab19c2', '0c97a066-9a56-48eb-836e-91cba0f4d610', 'c2bdda96-bc09-4005-bfa0-cac879631eb2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:45:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Delete snapshot completed successfully. Aug 11 06:45:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-73a41fdb-cf40-4788-8676-9eb4b261715e tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-0ea0a14d-1eda-4db3-8106-7173cdd163f3-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-941dde93-9873-4937-b806-10a0081d9130-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-941dde93-9873-4937-b806-10a0081d9130-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e579b-3715-4df7-a67f-6bca46ba63ed]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:59 devstack sudo[112126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 Aug 11 06:45:59 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faad8a2-2c7d-421b-8dff-9e7425328647]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:59 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130" returned: 0 in 0.410s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:45:59 devstack sudo[112132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130 Aug 11 06:45:59 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:59 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 Aug 11 06:45:59 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:45:59 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-941dde93-9873-4937-b806-10a0081d9130" returned: 0 in 0.243s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:45:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-quobyte-941dde93-9873-4937-b806-10a0081d9130" released by "delete_volume" :: held 0.720s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Created reservations ['76a46122-62c1-4f1b-80a3-10e106f46eee', '2dce53f1-023d-418b-a7ee-bd09288f6434', '86a86aa6-bb76-4aad-a138-b7535e8b9c99', '6fd9ff06-f1ee-4495-932e-3ef02425ee40'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:00 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709" returned: 0 in 0.397s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 2G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:00 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:00 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 2G" returned: 0 in 0.157s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.575s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0c4c3041-d457-4d2b-be81-723f3f42388e tempest-VolumesExtendTest-14074564 None] Extend volume completed successfully. Aug 11 06:46:00 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.269s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Deleted volume successfully. Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b86ff3c4-46e0-4378-b66f-0a6b0df00d29 tempest-CreateVolumesFromSnapshotTest-1868859070 None] Lock "cinder-941dde93-9873-4937-b806-10a0081d9130-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-7ad35b40-946e-44d1-9b73-e07002fbc709-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "cinder-7ad35b40-946e-44d1-9b73-e07002fbc709-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-quobyte-7ad35b40-946e-44d1-9b73-e07002fbc709" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-7ad35b40-946e-44d1-9b73-e07002fbc709" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[17187b24-8a56-436d-9b37-b6df0c302f71]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:01 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 Aug 11 06:46:01 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:01 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709" returned: 0 in 0.414s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:01 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709 Aug 11 06:46:01 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:01 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-7ad35b40-946e-44d1-9b73-e07002fbc709" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-7ad35b40-946e-44d1-9b73-e07002fbc709" released by "delete_volume" :: held 0.774s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Created reservations ['9cf9ca77-d2c8-4794-984b-75343114fd84', 'dca7cd2b-36b9-4b8a-8d45-43d36bccddb4', 'cfc2de42-ad12-4e23-9304-2212b99c24d6', 'f9a3162a-79b3-44e6-a3bd-5231773c6393'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:01 devstack sudo[112156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:01 devstack sudo[112156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:02 devstack sudo[112156]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:02 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Deleted volume successfully. Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d48c787f-26fd-45a0-83ed-8b498affb815 tempest-VolumesExtendTest-14074564 None] Lock "cinder-7ad35b40-946e-44d1-9b73-e07002fbc709-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Flow 'volume_create_manager' (6b2e26b3-277b-4b37-a870-4108acf0161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd00e5c-0626-4402-9037-09413d82c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd00e5c-0626-4402-9037-09413d82c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1539221227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c81c9df-6e60-41fd-b694-e67d8e7bdc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a730a1c5ba974bd6a3900c37e0a6df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:03Z,use_quota=True,user_id='d7c5b58462f24c9c9b79d63577744667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea767f95-98e8-43ca-8238-f912786bdafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea767f95-98e8-43ca-8238-f912786bdafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5a338b-b719-41bc-8250-e8142f33a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5a338b-b719-41bc-8250-e8142f33a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c81c9df-6e60-41fd-b694-e67d8e7bdc4d', 'volume_name': 'volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1830fcad-b9b5-4bff-8424-1e95a89609ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1830fcad-b9b5-4bff-8424-1e95a89609ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862fcdbb-801a-49a7-a0e4-15a267b2e1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:02 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Volume 3c81c9df-6e60-41fd-b694-e67d8e7bdc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d', 'volume_size': 1} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1539221227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c81c9df-6e60-41fd-b694-e67d8e7bdc4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a730a1c5ba974bd6a3900c37e0a6df55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:03Z,use_quota=True,user_id='d7c5b58462f24c9c9b79d63577744667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Creating volume 3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:02 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:02 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d 1073741824 Aug 11 06:46:02 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:03 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d 1073741824" returned: 0 in 0.493s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:03 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:03 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:03 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.254s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862fcdbb-801a-49a7-a0e4-15a267b2e1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b86504-032d-44eb-b70a-59667ebf9192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Volume volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d (3c81c9df-6e60-41fd-b694-e67d8e7bdc4d): created successfully Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b86504-032d-44eb-b70a-59667ebf9192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Flow 'volume_create_manager' (6b2e26b3-277b-4b37-a870-4108acf0161b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7cbc0fd8-35c3-4567-ad73-3d1e5a67a931 tempest-VolumesExtendTest-14074564 None] Created volume successfully. Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Flow 'volume_create_manager' (2939797c-30f4-4556-b416-ff45fc13b3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be756dd1-f403-48ed-bdea-629f20ed44e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be756dd1-f403-48ed-bdea-629f20ed44e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047701491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b19e117-0835-4ac3-8b81-28f95e8986d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed621bf681747a587ed5343f91e2b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:04Z,use_quota=True,user_id='ce343c5665dd4024b6d0fdc5d433c28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35157961-a804-4818-8b56-160bf33337e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35157961-a804-4818-8b56-160bf33337e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e08abc2-0225-412d-9bc1-0c314b03c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e08abc2-0225-412d-9bc1-0c314b03c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b19e117-0835-4ac3-8b81-28f95e8986d9', 'volume_name': 'volume-1b19e117-0835-4ac3-8b81-28f95e8986d9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b84c5bd-af03-4b3a-b852-ea0e3eb020da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b84c5bd-af03-4b3a-b852-ea0e3eb020da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bff1c8-fd1d-446d-888d-683bc3652752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Volume 1b19e117-0835-4ac3-8b81-28f95e8986d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b19e117-0835-4ac3-8b81-28f95e8986d9', 'volume_size': 1} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047701491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b19e117-0835-4ac3-8b81-28f95e8986d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed621bf681747a587ed5343f91e2b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:04Z,use_quota=True,user_id='ce343c5665dd4024b6d0fdc5d433c28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Creating volume 1b19e117-0835-4ac3-8b81-28f95e8986d9 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:04 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:04 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 1073741824 Aug 11 06:46:04 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:04 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 1073741824" returned: 0 in 0.453s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:04 devstack sudo[112173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 Aug 11 06:46:04 devstack sudo[112173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:05 devstack sudo[112173]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9" returned: 0 in 0.259s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.225s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bff1c8-fd1d-446d-888d-683bc3652752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b19e117-0835-4ac3-8b81-28f95e8986d9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cde42b-83f9-45c6-925a-13a141aea9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Creating offline snapshot 264363e4-d715-461c-9705-8fd13656057f of volume 3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:46:05 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Volume volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 (1b19e117-0835-4ac3-8b81-28f95e8986d9): created successfully Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cde42b-83f9-45c6-925a-13a141aea9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Flow 'volume_create_manager' (2939797c-30f4-4556-b416-ff45fc13b3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec4dfa1-e70a-4462-9609-87f705449283]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2d01e814-a65e-4107-9793-33854825ffd1 tempest-ProjectReaderTests-1605873513 None] Created volume successfully. Aug 11 06:46:05 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:05 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:05 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:05 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f 1G Aug 11 06:46:05 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:05 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f 1G" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f Aug 11 06:46:06 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:06 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f is being set with open permissions: ugo+rw Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f Aug 11 06:46:06 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Acquiring lock "cinder-1b19e117-0835-4ac3-8b81-28f95e8986d9-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "cinder-1b19e117-0835-4ac3-8b81-28f95e8986d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Acquiring lock "cinder-quobyte-1b19e117-0835-4ac3-8b81-28f95e8986d9" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "cinder-quobyte-1b19e117-0835-4ac3-8b81-28f95e8986d9" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07d77f-3065-48b1-9ac1-5912072d9986]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info Aug 11 06:46:06 devstack sudo[112196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:06 devstack sudo[112195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 Aug 11 06:46:06 devstack sudo[112195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:06 devstack sudo[112196]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info is being set with open permissions: ugo+rw Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info Aug 11 06:46:06 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:06 devstack sudo[112195]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9" returned: 0 in 0.400s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:06 devstack sudo[112205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9 Aug 11 06:46:06 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:07 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.info" returned: 0 in 0.253s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8ed05efb-0200-49fa-b74c-0e6079aa370c tempest-VolumesExtendTest-14074564 None] Create snapshot completed successfully Aug 11 06:46:07 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1b19e117-0835-4ac3-8b81-28f95e8986d9" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "cinder-quobyte-1b19e117-0835-4ac3-8b81-28f95e8986d9" released by "delete_volume" :: held 0.709s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Created reservations ['43bbc433-7d6a-4d51-a85d-05e7e7c55ba2', '452065dc-ef74-44f6-a762-868d650d40a0', 'a2807f4d-1ea2-40ce-bcef-29eccfd4a809', '0d5478f1-e480-4e41-878d-8da33ed163c1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:07 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:07 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:07 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Deleted volume successfully. Aug 11 06:46:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1c190707-96d7-4132-be67-19760b6fe05a tempest-ProjectReaderTests-1605873513 None] Lock "cinder-1b19e117-0835-4ac3-8b81-28f95e8986d9-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Flow 'volume_create_manager' (b595e1c7-1641-4628-8f1e-8f47d5d5b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1113d9d-21b0-4bf0-af39-a64de006a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec5825-cb46-47fc-86d0-6d6403d5f487]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=118,cinder:INSERT=46,cinder:UPDATE=165,cinder:DELETE=13 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1113d9d-21b0-4bf0-af39-a64de006a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577967771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27f8041-1e71-4265-be27-02b99bab82a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed621bf681747a587ed5343f91e2b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:08Z,use_quota=True,user_id='ce343c5665dd4024b6d0fdc5d433c28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50b7864-d7fa-463c-9649-81cf12ec8d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50b7864-d7fa-463c-9649-81cf12ec8d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4251a07-5770-4d24-a12d-26ff52345171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4251a07-5770-4d24-a12d-26ff52345171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27f8041-1e71-4265-be27-02b99bab82a1', 'volume_name': 'volume-a27f8041-1e71-4265-be27-02b99bab82a1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a38242-e394-4fea-986d-8da1a0f58bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a38242-e394-4fea-986d-8da1a0f58bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec083b12-9d3e-4770-9de6-06ab9555242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Volume a27f8041-1e71-4265-be27-02b99bab82a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27f8041-1e71-4265-be27-02b99bab82a1', 'volume_size': 1} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:08 devstack sudo[112213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:08 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:08 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f 2G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f 2G" returned: 0 in 0.120s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.577s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577967771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27f8041-1e71-4265-be27-02b99bab82a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed621bf681747a587ed5343f91e2b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:08Z,use_quota=True,user_id='ce343c5665dd4024b6d0fdc5d433c28f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Creating volume a27f8041-1e71-4265-be27-02b99bab82a1 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:08 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:08 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 1073741824 Aug 11 06:46:08 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:08 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3a8f35c8-964d-4c2e-8ad5-3d6660a1accd tempest-VolumesExtendTest-14074564 None] Extend volume completed successfully. Aug 11 06:46:09 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 1073741824" returned: 0 in 0.460s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:09 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 Aug 11 06:46:09 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-264363e4-d715-461c-9705-8fd13656057f-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-264363e4-d715-461c-9705-8fd13656057f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-quobyte-264363e4-d715-461c-9705-8fd13656057f" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-264363e4-d715-461c-9705-8fd13656057f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Deleting offline snapshot 264363e4-d715-461c-9705-8fd13656057f of volume 3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] snapshot_file for this snap is: volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974b857-4a92-40fa-b825-cdcab5c9b49a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:09 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1" returned: 0 in 0.274s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec083b12-9d3e-4770-9de6-06ab9555242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27f8041-1e71-4265-be27-02b99bab82a1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb742b-2bb8-40cc-aba2-feddc5f30cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:09 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Volume volume-a27f8041-1e71-4265-be27-02b99bab82a1 (a27f8041-1e71-4265-be27-02b99bab82a1): created successfully Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbb742b-2bb8-40cc-aba2-feddc5f30cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Flow 'volume_create_manager' (b595e1c7-1641-4628-8f1e-8f47d5d5b69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a025c4c3-e44f-4ab8-9487-ec9dedd1ce05 tempest-ProjectReaderTests-1605873513 None] Created volume successfully. Aug 11 06:46:09 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f Aug 11 06:46:09 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:09 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeee511-9767-4545-a98c-bbe368e96ab5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:10 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:10 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Acquiring lock "cinder-a27f8041-1e71-4265-be27-02b99bab82a1-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "cinder-a27f8041-1e71-4265-be27-02b99bab82a1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Acquiring lock "cinder-quobyte-a27f8041-1e71-4265-be27-02b99bab82a1" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "cinder-quobyte-a27f8041-1e71-4265-be27-02b99bab82a1" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:10 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.481s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbca0df9-9e22-4e17-a620-1ba764e240a7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:10 devstack sudo[112241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f Aug 11 06:46:10 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:10 devstack sudo[112242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 Aug 11 06:46:10 devstack sudo[112242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:10 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:10 devstack sudo[112242]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:10 devstack sudo[112251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f Aug 11 06:46:10 devstack sudo[112251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:10 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1 Aug 11 06:46:10 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:11 devstack sudo[112251]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d.264363e4-d715-461c-9705-8fd13656057f" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:11 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a27f8041-1e71-4265-be27-02b99bab82a1" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-264363e4-d715-461c-9705-8fd13656057f" released by "_delete_snapshot" :: held 1.632s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" released by "delete_snapshot" :: held 1.659s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "cinder-quobyte-a27f8041-1e71-4265-be27-02b99bab82a1" released by "delete_volume" :: held 0.719s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Created reservations ['c7bf1a46-7fdf-4b52-ad10-05008f36f7f0', '6e5285ce-2057-4fbb-939d-30201eaa6375', '8a25ef3e-fb2f-4862-83aa-0963f8478a73', '85884bbd-137d-4467-8183-860ad231ce0c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Created reservations ['0037233b-0353-4d2f-b1ed-2e42adc16490', '4f90d15c-e3f0-4e21-9c59-94bf7190b408', '37478aed-70a9-481d-9bbc-f093f826db4b', 'b06e5daa-2380-42d7-a4aa-71a0486a2697'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:11 devstack sudo[112257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:11 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Delete snapshot completed successfully. Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3d88e4b7-f3f2-4cb6-ae85-218d6fc47a80 tempest-VolumesExtendTest-14074564 None] Lock "cinder-264363e4-d715-461c-9705-8fd13656057f-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:11 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Deleted volume successfully. Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f5276129-b826-4073-94e2-9121851947fa tempest-ProjectReaderTests-1605873513 None] Lock "cinder-a27f8041-1e71-4265-be27-02b99bab82a1-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "cinder-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Acquiring lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32dfc97-0a69-4203-acb7-de989bb8556e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:11 devstack sudo[112260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:11 devstack sudo[112260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:12 devstack sudo[112260]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.409s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:12 devstack sudo[112265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d Aug 11 06:46:12 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:12 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "cinder-quobyte-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d" released by "delete_volume" :: held 0.733s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Created reservations ['311246e2-3fc1-4dc4-bfb7-16c660440674', 'e30f4910-e4c5-44a0-879a-95837fb240d0', 'f0a925dc-71e8-4013-9a99-f0396238a736', '5f76fea8-0dca-4a71-a966-d1a73b122f77'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:12 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:12 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:12 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.272s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Deleted volume successfully. Aug 11 06:46:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d2ab3167-1f02-4a32-9b8e-081601a41b75 tempest-VolumesExtendTest-14074564 None] Lock "cinder-3c81c9df-6e60-41fd-b694-e67d8e7bdc4d-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:15 devstack sudo[112271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:15 devstack sudo[112271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:15 devstack sudo[112271]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.292s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:46:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Flow 'volume_create_manager' (af064f4f-e410-402a-ae0b-83de65ace1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9477e2be-4369-47d6-8ee5-3f3df6610605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9477e2be-4369-47d6-8ee5-3f3df6610605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-265047201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76fc8e-f1e1-4110-ab89-6709d73462d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a9a560eff4e8ca12709111be33d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:16Z,use_quota=True,user_id='ce9132b8eef64725aed633cddd10a5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8afae8-cfd7-40f9-b5b5-6454d5657ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8afae8-cfd7-40f9-b5b5-6454d5657ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba788dd5-9485-4eea-b5c3-c325c97f344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba788dd5-9485-4eea-b5c3-c325c97f344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee76fc8e-f1e1-4110-ab89-6709d73462d8', 'volume_name': 'volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f9372-11b5-4b29-9b08-3df35320e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f9372-11b5-4b29-9b08-3df35320e154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b723bf3-7d5d-4119-bfc6-8dd086d36978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:16 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Volume ee76fc8e-f1e1-4110-ab89-6709d73462d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8', 'volume_size': 1} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-265047201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76fc8e-f1e1-4110-ab89-6709d73462d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b6a9a560eff4e8ca12709111be33d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:16Z,use_quota=True,user_id='ce9132b8eef64725aed633cddd10a5f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Creating volume ee76fc8e-f1e1-4110-ab89-6709d73462d8 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:16 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:16 devstack sudo[112274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 1073741824 Aug 11 06:46:16 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:16 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 1073741824" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:16 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 Aug 11 06:46:16 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:17 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8" returned: 0 in 0.299s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b723bf3-7d5d-4119-bfc6-8dd086d36978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1caa3519-5d99-4773-b786-19beb1069227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:17 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Volume volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 (ee76fc8e-f1e1-4110-ab89-6709d73462d8): created successfully Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1caa3519-5d99-4773-b786-19beb1069227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:17 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Flow 'volume_create_manager' (af064f4f-e410-402a-ae0b-83de65ace1b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e667b5f7-a689-4cd8-903b-d607c72a2f28 tempest-VolumesNegativeTest-1394498690 None] Created volume successfully. Aug 11 06:46:27 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=110,cinder:UPDATE=138,cinder:DELETE=13,cinder:INSERT=38 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:46:27 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=22,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Acquiring lock "cinder-ee76fc8e-f1e1-4110-ab89-6709d73462d8-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "cinder-ee76fc8e-f1e1-4110-ab89-6709d73462d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Acquiring lock "cinder-quobyte-ee76fc8e-f1e1-4110-ab89-6709d73462d8" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "cinder-quobyte-ee76fc8e-f1e1-4110-ab89-6709d73462d8" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12dbb1d-94dc-44b4-85e2-8e04bdd3d179]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:38 devstack sudo[112455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 Aug 11 06:46:38 devstack sudo[112455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:38 devstack sudo[112455]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:38 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8 Aug 11 06:46:38 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:38 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ee76fc8e-f1e1-4110-ab89-6709d73462d8" returned: 0 in 0.242s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "cinder-quobyte-ee76fc8e-f1e1-4110-ab89-6709d73462d8" released by "delete_volume" :: held 0.705s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Created reservations ['bfb2da88-5283-4aff-850d-22eeadbbf9a1', '6f548db3-8279-46b9-87ff-5240cc44da7e', '5df4899b-adf2-4874-9f66-a0d52cf59193', '20423a05-5be1-4c88-bb47-f32ac995ae7f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:39 devstack sudo[112463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:39 devstack sudo[112463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:39 devstack sudo[112463]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:39 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Deleted volume successfully. Aug 11 06:46:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b961b405-4124-478e-ae65-d5bf1a74cd38 tempest-VolumesNegativeTest-1394498690 None] Lock "cinder-ee76fc8e-f1e1-4110-ab89-6709d73462d8-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Flow 'volume_create_manager' (c37be331-b85d-4735-aa45-4cd4a68953f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc69827-9db0-4dcb-bd92-2d0e4eaccfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc69827-9db0-4dcb-bd92-2d0e4eaccfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-855512856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dbcf66-f3b2-48e0-8b02-093636822633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4de97edd97427fa03084df6671b97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:42Z,use_quota=True,user_id='348e9a935a92465dadc9c6115de9455c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2a25a1-5fb6-46b3-aedd-1f6e0f80c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2a25a1-5fb6-46b3-aedd-1f6e0f80c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cea96-7475-4031-9aca-465bb71888a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cea96-7475-4031-9aca-465bb71888a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dbcf66-f3b2-48e0-8b02-093636822633', 'volume_name': 'volume-b6dbcf66-f3b2-48e0-8b02-093636822633', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfb6ed7-6abd-425b-ae97-26519c3ef1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfb6ed7-6abd-425b-ae97-26519c3ef1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb770d5a-f87f-4f1b-bb39-e6bdf723bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Volume b6dbcf66-f3b2-48e0-8b02-093636822633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dbcf66-f3b2-48e0-8b02-093636822633', 'volume_size': 1} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-855512856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dbcf66-f3b2-48e0-8b02-093636822633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4de97edd97427fa03084df6671b97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:42Z,use_quota=True,user_id='348e9a935a92465dadc9c6115de9455c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Creating volume b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:42 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:42 devstack sudo[112467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 1073741824 Aug 11 06:46:42 devstack sudo[112467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Flow 'volume_create_manager' (e3c00295-04c7-4f64-a729-db655a3f1088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1e9f01-c464-487e-b97b-0069d97abc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1e9f01-c464-487e-b97b-0069d97abc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2138708799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d66d92-4a7d-402a-a098-9bfc7a8f1387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2d3163c0b46419450994996a32263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:42Z,use_quota=True,user_id='ebf1e6f3c6a14820b154bdc459196bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2be36e-cf64-4ad0-bc3a-8a8ccab15834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2be36e-cf64-4ad0-bc3a-8a8ccab15834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677543c-f1be-40d9-aff5-afa4dbc7cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677543c-f1be-40d9-aff5-afa4dbc7cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d66d92-4a7d-402a-a098-9bfc7a8f1387', 'volume_name': 'volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03756dcd-7ed1-4c1e-9d34-ea200ee22019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03756dcd-7ed1-4c1e-9d34-ea200ee22019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9109ec0-2275-4560-be09-2ad467e2d5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387', 'volume_size': 1} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:42 devstack sudo[112467]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 1073741824" returned: 0 in 0.464s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:42 devstack sudo[112473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:42 devstack sudo[112473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:43 devstack sudo[112473]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2138708799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d66d92-4a7d-402a-a098-9bfc7a8f1387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad2d3163c0b46419450994996a32263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:42Z,use_quota=True,user_id='ebf1e6f3c6a14820b154bdc459196bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Creating volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:43 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb770d5a-f87f-4f1b-bb39-e6bdf723bea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dbcf66-f3b2-48e0-8b02-093636822633', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a57ee1-a831-4238-9e5c-57a50136d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:43 devstack sudo[112476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 1073741824 Aug 11 06:46:43 devstack sudo[112476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:43 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Volume volume-b6dbcf66-f3b2-48e0-8b02-093636822633 (b6dbcf66-f3b2-48e0-8b02-093636822633): created successfully Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a57ee1-a831-4238-9e5c-57a50136d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Flow 'volume_create_manager' (c37be331-b85d-4735-aa45-4cd4a68953f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6df963d1-6c25-4e61-bbdf-4c30ab56dff1 tempest-SnapshotDependencyTests-956017731 None] Created volume successfully. Aug 11 06:46:43 devstack sudo[112476]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 1073741824" returned: 0 in 0.443s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:43 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 Aug 11 06:46:43 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:43 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:46:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9109ec0-2275-4560-be09-2ad467e2d5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6bb65-ebab-40af-9df8-be1f9b14f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Volume volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 (13d66d92-4a7d-402a-a098-9bfc7a8f1387): created successfully Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6bb65-ebab-40af-9df8-be1f9b14f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Flow 'volume_create_manager' (e3c00295-04c7-4f64-a729-db655a3f1088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ff2351d5-f384-451d-8ffc-a9e5c343d5ff tempest-VolumesSnapshotListTestJSON-2080225275 None] Created volume successfully. Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Creating offline snapshot 9d686afc-b951-4a75-bf60-72cebd593cd8 of volume b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec637ff-8fe6-40ee-a449-84924a3284a1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:44 devstack sudo[112484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:44 devstack sudo[112484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:44 devstack sudo[112484]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.353s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:44 devstack sudo[112489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 1G Aug 11 06:46:44 devstack sudo[112489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:45 devstack sudo[112489]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 1G" returned: 0 in 0.433s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dbcf66-f3b2-48e0-8b02-093636822633 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:45 devstack sudo[112495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dbcf66-f3b2-48e0-8b02-093636822633 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:45 devstack sudo[112495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:45 devstack sudo[112495]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dbcf66-f3b2-48e0-8b02-093636822633 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.300s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:45 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 is being set with open permissions: ugo+rw Aug 11 06:46:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:45 devstack sudo[112500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:45 devstack sudo[112500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:45 devstack sudo[112500]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.258s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:46 devstack sudo[112503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info Aug 11 06:46:46 devstack sudo[112503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:46 devstack sudo[112503]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info" returned: 0 in 0.267s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:46 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info is being set with open permissions: ugo+rw Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:46 devstack sudo[112506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info Aug 11 06:46:46 devstack sudo[112506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:46 devstack sudo[112506]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.info" returned: 0 in 0.246s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.919s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Creating offline snapshot 40e9f2b4-1ac1-43a8-89ee-29ca4728f40c of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:46:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-19680193-f345-4735-93b9-b87dc069352a tempest-SnapshotDependencyTests-956017731 None] Create snapshot completed successfully Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837e8d6-760a-4c90-9ca7-154ff81e4dce]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:46 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 Aug 11 06:46:46 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:46 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:47 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c 1G Aug 11 06:46:47 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:47 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c 1G" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:47 devstack sudo[112519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:46:47 devstack sudo[112519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:47 devstack sudo[112519]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:47 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c is being set with open permissions: ugo+rw Aug 11 06:46:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:47 devstack sudo[112524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:46:47 devstack sudo[112524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:48 devstack sudo[112524]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.296s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:48 devstack sudo[112527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info Aug 11 06:46:48 devstack sudo[112527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:46:48 devstack sudo[112527]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:48 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info is being set with open permissions: ugo+rw Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:48 devstack sudo[112530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info Aug 11 06:46:48 devstack sudo[112530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Flow 'volume_create_manager' (329cc915-4fff-4518-aece-c58b9150e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9358861-e853-40ca-98ab-71549453d5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9358861-e853-40ca-98ab-71549453d5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d836a2e0-107c-47de-8fd6-34f1e3c3ea60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4de97edd97427fa03084df6671b97b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d686afc-b951-4a75-bf60-72cebd593cd8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:46:48Z,use_quota=True,user_id='348e9a935a92465dadc9c6115de9455c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab13b15f-6aa3-4a8e-8bc4-af69e4a3a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab13b15f-6aa3-4a8e-8bc4-af69e4a3a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded8ab84-e27f-4525-8b3b-18e0c306d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded8ab84-e27f-4525-8b3b-18e0c306d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd836a2e0-107c-47de-8fd6-34f1e3c3ea60', 'volume_name': 'volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60', 'volume_size': 1, 'snapshot_id': '9d686afc-b951-4a75-bf60-72cebd593cd8'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f39d6b-12fb-4b42-b519-6f214273813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f39d6b-12fb-4b42-b519-6f214273813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3f2dcf-43ff-441d-a23f-c8bd2bb52541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:48 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Volume d836a2e0-107c-47de-8fd6-34f1e3c3ea60: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60', 'volume_size': 1, 'snapshot_id': '9d686afc-b951-4a75-bf60-72cebd593cd8'} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:48 devstack sudo[112530]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.info" returned: 0 in 0.247s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.157s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Creating volume d836a2e0-107c-47de-8fd6-34f1e3c3ea60 from snapshot 9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3966ef9d-f1e9-416d-9398-650d81392ab1 tempest-VolumesSnapshotListTestJSON-2080225275 None] Create snapshot completed successfully Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] snapshot: 9d686afc-b951-4a75-bf60-72cebd593cd8, volume: d836a2e0-107c-47de-8fd6-34f1e3c3ea60, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca5de1-1ce1-42b0-91e4-4bb22ee02aa2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:48 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:48 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:49 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6dbcf66-f3b2-48e0-8b02-093636822633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f243bbf-b7ad-4d5f-9103-f2ad94d77944]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:49 devstack sudo[112538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:49 devstack sudo[112538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:49 devstack sudo[112538]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.381s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:46:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:49 devstack sudo[112543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 Aug 11 06:46:49 devstack sudo[112543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:53 devstack sudo[112543]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" returned: 0 in 4.034s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:46:53 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Converted 1024.00 MB image at 253.77 MB/s Aug 11 06:46:53 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 is being set with open permissions: ugo+rw Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:53 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 Aug 11 06:46:53 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:53 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" returned: 0 in 0.231s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" released by "_copy_volume_from_snapshot" :: held 5.106s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" released by "_create_volume_from_snapshot" :: held 5.175s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.200s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.875s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Creating offline snapshot 859b2831-e545-488b-8221-34dedf1b1609 of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3f2dcf-43ff-441d-a23f-c8bd2bb52541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60', 'volume_size': 1, 'snapshot_id': '9d686afc-b951-4a75-bf60-72cebd593cd8'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e417b8c-e22a-4380-9cf8-6b9cb831a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771125f-c73f-4a8c-9493-e370964f1f79]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Volume volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 (d836a2e0-107c-47de-8fd6-34f1e3c3ea60): created successfully Aug 11 06:46:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e417b8c-e22a-4380-9cf8-6b9cb831a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Flow 'volume_create_manager' (329cc915-4fff-4518-aece-c58b9150e708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:46:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fe93cfc4-ed41-40b3-ba1f-d85874e65932 tempest-SnapshotDependencyTests-956017731 None] Created volume successfully. Aug 11 06:46:54 devstack sudo[112560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:46:54 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:54 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.388s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:54 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 1G Aug 11 06:46:54 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:54 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 1G" returned: 0 in 0.504s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-9d686afc-b951-4a75-bf60-72cebd593cd8-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:54 devstack sudo[112571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:46:54 devstack sudo[112571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-9d686afc-b951-4a75-bf60-72cebd593cd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Deleting offline snapshot 9d686afc-b951-4a75-bf60-72cebd593cd8 of volume b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] snapshot_file for this snap is: volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce847e-b382-4301-a4ee-7cd9ec5e5633]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:55 devstack sudo[112573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:55 devstack sudo[112573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:55 devstack sudo[112571]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:55 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 is being set with open permissions: ugo+rw Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:55 devstack sudo[112578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:46:55 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:55 devstack sudo[112573]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.424s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6dbcf66-f3b2-48e0-8b02-093636822633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f8224-463d-48c9-98b0-16f8e0d9fec8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:55 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.606s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3215db33-ce8b-4db8-b6bd-6e63315e0fe9 tempest-VolumesSnapshotListTestJSON-2080225275 None] Create snapshot completed successfully Aug 11 06:46:55 devstack sudo[112586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:55 devstack sudo[112586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:55 devstack sudo[112586]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:55 devstack sudo[112591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:55 devstack sudo[112591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:56 devstack sudo[112591]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:56 devstack sudo[112598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.325s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:56 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:56 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633.9d686afc-b951-4a75-bf60-72cebd593cd8" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Creating offline snapshot 4f00238f-bb22-447f-8d61-1503e6cab550 of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-9d686afc-b951-4a75-bf60-72cebd593cd8" released by "_delete_snapshot" :: held 1.711s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" released by "delete_snapshot" :: held 1.737s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[94051ea7-4f2e-4bde-a7cd-d40696009cba]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Created reservations ['9a735bf2-6054-4fb0-96f7-6aaddb44fbaa', '06dcda2a-e263-46ff-b120-76d7fe07e27d', '311a1aa5-3a9a-4f9e-ba15-5446ca71cf5a', 'a33bc8d7-e9b5-4519-97c6-0d2f12cea590'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Delete snapshot completed successfully. Aug 11 06:46:56 devstack sudo[112601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:46:56 devstack sudo[112601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8a837154-1e3a-447a-8f30-3f760b0f9f41 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-9d686afc-b951-4a75-bf60-72cebd593cd8-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-b6dbcf66-f3b2-48e0-8b02-093636822633-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:57 devstack sudo[112601]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.409s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:57 devstack sudo[112606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 1G Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-b6dbcf66-f3b2-48e0-8b02-093636822633-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:57 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e09ea-e122-4ad9-bc14-7cbc24fc3fc6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:57 devstack sudo[112608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:57 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:57 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 1G" returned: 0 in 0.547s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:57 devstack sudo[112617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 Aug 11 06:46:57 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:57 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.443s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:57 devstack sudo[112619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633 Aug 11 06:46:57 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:57 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:57 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 is being set with open permissions: ugo+rw Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:57 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:57 devstack sudo[112625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 Aug 11 06:46:57 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b6dbcf66-f3b2-48e0-8b02-093636822633" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-b6dbcf66-f3b2-48e0-8b02-093636822633" released by "delete_volume" :: held 0.786s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Created reservations ['658621d9-41be-4507-bb7b-9d002e6b02f9', 'f85c5f47-7a4f-4821-8b10-15033125b8cd', '8818df27-fca8-400a-bdf1-ade85ec4bd47', '53dbe3d9-98a0-4d08-8e8f-53cd891c92d1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:58 devstack sudo[112627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:58 devstack sudo[112627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:58 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.646s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-d836a2e0-107c-47de-8fd6-34f1e3c3ea60-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-77451ab6-68a5-443e-8d00-db488b86565f tempest-VolumesSnapshotListTestJSON-2080225275 None] Create snapshot completed successfully Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-d836a2e0-107c-47de-8fd6-34f1e3c3ea60-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[415aeaf4-f939-4997-b0f8-c89096bb9fd6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:58 devstack sudo[112627]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.304s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Deleted volume successfully. Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e136286-7453-404c-9453-5e54aff573b0 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-b6dbcf66-f3b2-48e0-8b02-093636822633-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:58 devstack sudo[112631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 Aug 11 06:46:58 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:58 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" returned: 0 in 0.398s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:58 devstack sudo[112636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60 Aug 11 06:46:58 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:59 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" returned: 0 in 0.262s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-quobyte-d836a2e0-107c-47de-8fd6-34f1e3c3ea60" released by "delete_volume" :: held 0.700s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Created reservations ['6c23ca70-011e-4ec5-90ea-48dc05b2e405', 'f92414c3-6833-4d0d-adbb-8f4a182ae3ea', 'f265a8db-55fb-4e4c-a14b-cc459c289f15', '44cc7257-9789-437b-8e78-c8fd24f546d7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:59 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:46:59 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:46:59 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:46:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Deleted volume successfully. Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-4f00238f-bb22-447f-8d61-1503e6cab550-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-37210170-04a2-4607-9158-315948812f60 tempest-SnapshotDependencyTests-956017731 None] Lock "cinder-d836a2e0-107c-47de-8fd6-34f1e3c3ea60-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-4f00238f-bb22-447f-8d61-1503e6cab550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-4f00238f-bb22-447f-8d61-1503e6cab550" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-4f00238f-bb22-447f-8d61-1503e6cab550" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Deleting offline snapshot 4f00238f-bb22-447f-8d61-1503e6cab550 of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] snapshot_file for this snap is: volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1b9f76-8adf-4622-9aa7-ecbd93a9975a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:46:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:46:59 devstack sudo[112642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 Aug 11 06:46:59 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:00 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd28a0c-37c5-4b30-8831-a77543e3bd9d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:00 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:47:00 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:00 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.418s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:00 devstack sudo[112653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 Aug 11 06:47:00 devstack sudo[112653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:00 devstack sudo[112653]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550" returned: 0 in 0.451s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:00 devstack sudo[112658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550 Aug 11 06:47:00 devstack sudo[112658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:01 devstack sudo[112658]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.4f00238f-bb22-447f-8d61-1503e6cab550" returned: 0 in 0.302s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-4f00238f-bb22-447f-8d61-1503e6cab550" released by "_delete_snapshot" :: held 1.698s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" released by "delete_snapshot" :: held 1.727s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Created reservations ['25efd7cf-7679-4685-b0c4-ff2e15e747de', '49df0b6d-9b63-44aa-bb99-d9a7dd7b707a', '40c97d80-d5d3-409f-b71e-875fbe56a1e1', 'c5d1ea73-65b4-46fa-a740-a7cc89a5a698'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Delete snapshot completed successfully. Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-34e8da1c-a197-4002-9a16-de9e97e014ed tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-4f00238f-bb22-447f-8d61-1503e6cab550-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-859b2831-e545-488b-8221-34dedf1b1609-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-859b2831-e545-488b-8221-34dedf1b1609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-859b2831-e545-488b-8221-34dedf1b1609" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-859b2831-e545-488b-8221-34dedf1b1609" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Deleting offline snapshot 859b2831-e545-488b-8221-34dedf1b1609 of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] snapshot_file for this snap is: volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81984b69-9b62-47d4-9faa-4bf1bec33dc1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:01 devstack sudo[112662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:47:01 devstack sudo[112662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:02 devstack sudo[112662]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.379s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2aa21-321a-4381-8311-f26511297e41]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:02 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:47:02 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:02 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.430s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:02 devstack sudo[112673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:47:02 devstack sudo[112673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:03 devstack sudo[112673]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:03 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609 Aug 11 06:47:03 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:03 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.859b2831-e545-488b-8221-34dedf1b1609" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-859b2831-e545-488b-8221-34dedf1b1609" released by "_delete_snapshot" :: held 1.663s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" released by "delete_snapshot" :: held 1.690s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Created reservations ['50cec1ba-4cc7-44c4-8ddb-d9250c955efd', '4bda4231-2781-4530-992b-6eab91257c65', '0b074e18-74e1-4300-9b02-ffc570331881', 'd2c806e1-8fd1-44c5-b2db-306ce88afa9d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Delete snapshot completed successfully. Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-82ac817e-7e7f-445b-a13b-71ee95cbb5f8 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-859b2831-e545-488b-8221-34dedf1b1609-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Deleting offline snapshot 40e9f2b4-1ac1-43a8-89ee-29ca4728f40c of volume 13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] snapshot_file for this snap is: volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ad3a1-0d59-4dff-9902-b8772744582c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:04 devstack sudo[112681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:47:04 devstack sudo[112681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:04 devstack sudo[112681]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab1b20-159d-4bee-b0c0-c35d2afbd295]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:04 devstack sudo[112687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 Aug 11 06:47:04 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:04 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387" returned: 0 in 0.364s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:04 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:47:04 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:05 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:05 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c Aug 11 06:47:05 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:05 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387.40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" returned: 0 in 0.259s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c" released by "_delete_snapshot" :: held 1.505s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" released by "delete_snapshot" :: held 1.530s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Created reservations ['bec5c142-0ae3-4e3a-8908-c06995634b1c', '97646732-a26c-4730-a657-81c9b44eee56', '43cf5391-f4ee-4c1c-9915-d75841ee41ee', 'c30aae93-58a3-4b79-a165-de327e1345f7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Delete snapshot completed successfully. Aug 11 06:47:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d4993b6c-0cf4-4002-88ef-8874467233fc tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-40e9f2b4-1ac1-43a8-89ee-29ca4728f40c-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-13d66d92-4a7d-402a-a098-9bfc7a8f1387-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-13d66d92-4a7d-402a-a098-9bfc7a8f1387-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e0f19f-b5ba-4c6a-8eca-539039cce9ed]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:06 devstack sudo[112701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 Aug 11 06:47:06 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:06 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:06 devstack sudo[112706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387 Aug 11 06:47:06 devstack sudo[112706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:06 devstack sudo[112706]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-13d66d92-4a7d-402a-a098-9bfc7a8f1387" returned: 0 in 0.249s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-quobyte-13d66d92-4a7d-402a-a098-9bfc7a8f1387" released by "delete_volume" :: held 0.710s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Created reservations ['52bd0b5c-63e6-4079-9d14-93c1ea0dffec', 'f97e1da9-e9aa-4492-a5b1-0ed1b7fa7642', '1abc7d2d-1226-44c5-a679-ff695179b310', 'fd0a21f8-d765-4898-9129-04269b3df1c5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:07 devstack sudo[112709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:07 devstack sudo[112709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:07 devstack sudo[112709]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.255s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:07 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Deleted volume successfully. Aug 11 06:47:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-01c1cf5f-8cc2-47e2-b1e1-568f73c135b4 tempest-VolumesSnapshotListTestJSON-2080225275 None] Lock "cinder-13d66d92-4a7d-402a-a098-9bfc7a8f1387-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (06c1bdd6-2c4e-4986-ac9b-6a6e04d3166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2b8376-b864-43f1-9c60-63c95889f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2b8376-b864-43f1-9c60-63c95889f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-378810955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928a32df-9ac6-402d-b581-09be53e26916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ada3a-1ecf-4d6d-a2a6-77c77e0c3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ada3a-1ecf-4d6d-a2a6-77c77e0c3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5577e01e-d5a0-4905-a677-4f863b2eda0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5577e01e-d5a0-4905-a677-4f863b2eda0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928a32df-9ac6-402d-b581-09be53e26916', 'volume_name': 'volume-928a32df-9ac6-402d-b581-09be53e26916', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbc0d19-836e-49ca-ad9b-750ac9b3b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbc0d19-836e-49ca-ad9b-750ac9b3b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095ef390-4397-4f1b-8c15-e79427123ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:10 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Volume 928a32df-9ac6-402d-b581-09be53e26916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928a32df-9ac6-402d-b581-09be53e26916', 'volume_size': 1} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-378810955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928a32df-9ac6-402d-b581-09be53e26916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Creating volume 928a32df-9ac6-402d-b581-09be53e26916 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:10 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:10 devstack sudo[112715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 1073741824 Aug 11 06:47:10 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (c8d95a88-a372-4c46-b269-7abb51fcdd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9989bf94-10b1-4769-8591-fddfd89111b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9989bf94-10b1-4769-8591-fddfd89111b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254992990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703895c0-6078-477f-b2bb-35af68a4dd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d361cd1-b88b-4aca-8ce3-736a6d5223ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d361cd1-b88b-4aca-8ce3-736a6d5223ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6805fc04-05a7-468f-bce2-eb5b84119271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6805fc04-05a7-468f-bce2-eb5b84119271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703895c0-6078-477f-b2bb-35af68a4dd2c', 'volume_name': 'volume-703895c0-6078-477f-b2bb-35af68a4dd2c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806cef20-aaf3-4495-af3b-62a585e00850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806cef20-aaf3-4495-af3b-62a585e00850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8f92f5-00d2-4969-aa5f-a878f6dfc35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Volume 703895c0-6078-477f-b2bb-35af68a4dd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703895c0-6078-477f-b2bb-35af68a4dd2c', 'volume_size': 1} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:11 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 1073741824" returned: 0 in 0.666s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (3227a3fe-7e75-4bc3-b189-d195a94fcba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e6194-2f96-445f-a88f-26b61f5d5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e6194-2f96-445f-a88f-26b61f5d5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79720660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4821ad-0e06-41fd-8c2f-69dd088ee1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f072b-6218-4af5-b0d9-343a4e23b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f072b-6218-4af5-b0d9-343a4e23b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad49496f-01de-496a-bea2-9f7813ec5f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad49496f-01de-496a-bea2-9f7813ec5f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4821ad-0e06-41fd-8c2f-69dd088ee1b8', 'volume_name': 'volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a31a3-2e62-4400-a969-fabc8b045b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239a31a3-2e62-4400-a969-fabc8b045b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a66af3-a366-4839-af1f-cd86ec247cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Volume 8b4821ad-0e06-41fd-8c2f-69dd088ee1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8', 'volume_size': 1} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:11 devstack sudo[112721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 Aug 11 06:47:11 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:11 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (e9d4be0e-f2a9-47bf-84c8-6848f0647ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997bd9ee-37e7-4e26-8ba5-979c0e14a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1254992990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703895c0-6078-477f-b2bb-35af68a4dd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Creating volume 703895c0-6078-477f-b2bb-35af68a4dd2c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997bd9ee-37e7-4e26-8ba5-979c0e14a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609649054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bbdd9-a56d-40d3-9e4d-252405dde687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:12Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a67948f-92c9-4d4d-b2bb-0354e6cd78b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack sudo[112724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c 1073741824 Aug 11 06:47:11 devstack sudo[112724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a67948f-92c9-4d4d-b2bb-0354e6cd78b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753b8ca5-bd27-457f-900e-5a818022d277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753b8ca5-bd27-457f-900e-5a818022d277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649bbdd9-a56d-40d3-9e4d-252405dde687', 'volume_name': 'volume-649bbdd9-a56d-40d3-9e4d-252405dde687', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94770534-f9fc-4939-880f-9dfd5a1d62d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94770534-f9fc-4939-880f-9dfd5a1d62d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6d6b90-865a-4dee-90bc-63251204ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Volume 649bbdd9-a56d-40d3-9e4d-252405dde687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649bbdd9-a56d-40d3-9e4d-252405dde687', 'volume_size': 1} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095ef390-4397-4f1b-8c15-e79427123ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928a32df-9ac6-402d-b581-09be53e26916', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d2f4fb-ff6b-42b0-869f-ec9e882f8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Volume volume-928a32df-9ac6-402d-b581-09be53e26916 (928a32df-9ac6-402d-b581-09be53e26916): created successfully Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d2f4fb-ff6b-42b0-869f-ec9e882f8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:11 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (06c1bdd6-2c4e-4986-ac9b-6a6e04d3166d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f3f4201f-e1ff-4cd0-8b70-e28de2159fab tempest-CreateVolumesFromImageTest-310005144 None] Created volume successfully. Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (9da159e0-7c6c-41f6-981f-ac2f5dd13069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc06b5-e82e-4a21-a19f-31caeb9f61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fc06b5-e82e-4a21-a19f-31caeb9f61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483594351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2600688c-4c85-468f-9d20-80956c680539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:12Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f348b0-9b10-4e51-87fc-642e66f244d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f348b0-9b10-4e51-87fc-642e66f244d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f603eb-c9da-4c88-9089-4cdf2f61b407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f603eb-c9da-4c88-9089-4cdf2f61b407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2600688c-4c85-468f-9d20-80956c680539', 'volume_name': 'volume-2600688c-4c85-468f-9d20-80956c680539', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4e0b9e-b4dc-4420-a3cc-a3e235aedd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4e0b9e-b4dc-4420-a3cc-a3e235aedd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3554f5a4-5cb6-4a72-9cfe-1a85e899bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Volume 2600688c-4c85-468f-9d20-80956c680539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2600688c-4c85-468f-9d20-80956c680539', 'volume_size': 1} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:12 devstack sudo[112724]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c 1073741824" returned: 0 in 0.496s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:12 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c Aug 11 06:47:12 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:12 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c" returned: 0 in 0.232s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79720660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4821ad-0e06-41fd-8c2f-69dd088ee1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:11Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Creating volume 8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:12 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:12 devstack sudo[112733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 1073741824 Aug 11 06:47:12 devstack sudo[112733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8f92f5-00d2-4969-aa5f-a878f6dfc35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703895c0-6078-477f-b2bb-35af68a4dd2c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66a21c2-d7f2-42cf-a5a1-ba77667450b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Volume volume-703895c0-6078-477f-b2bb-35af68a4dd2c (703895c0-6078-477f-b2bb-35af68a4dd2c): created successfully Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66a21c2-d7f2-42cf-a5a1-ba77667450b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (c8d95a88-a372-4c46-b269-7abb51fcdd8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f652eafc-08f0-4eb6-bf09-2c1984abb8a1 tempest-CreateVolumesFromImageTest-310005144 None] Created volume successfully. Aug 11 06:47:13 devstack sudo[112733]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 1073741824" returned: 0 in 0.427s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:13 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 Aug 11 06:47:13 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:13 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609649054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bbdd9-a56d-40d3-9e4d-252405dde687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:12Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Creating volume 649bbdd9-a56d-40d3-9e4d-252405dde687 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:13 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a66af3-a366-4839-af1f-cd86ec247cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:13 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 1073741824 Aug 11 06:47:13 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9117d30f-5eed-403c-878f-b27e7a775414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Volume volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 (8b4821ad-0e06-41fd-8c2f-69dd088ee1b8): created successfully Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9117d30f-5eed-403c-878f-b27e7a775414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (3227a3fe-7e75-4bc3-b189-d195a94fcba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6145fce0-465d-4065-aa7b-c6e2605a030b tempest-CreateVolumesFromImageTest-310005144 None] Created volume successfully. Aug 11 06:47:13 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 1073741824" returned: 0 in 0.461s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:13 devstack sudo[112747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 Aug 11 06:47:13 devstack sudo[112747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:14 devstack sudo[112747]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687" returned: 0 in 0.245s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483594351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2600688c-4c85-468f-9d20-80956c680539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a43b252f860549eab1e858e010fef7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:12Z,use_quota=True,user_id='ce856a559bda4e60a470b56b7c58c72a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Creating volume 2600688c-4c85-468f-9d20-80956c680539 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:14 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6d6b90-865a-4dee-90bc-63251204ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649bbdd9-a56d-40d3-9e4d-252405dde687', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:14 devstack sudo[112750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 1073741824 Aug 11 06:47:14 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2e4ab8-8ee5-46dd-bd1a-d64d9df15246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Volume volume-649bbdd9-a56d-40d3-9e4d-252405dde687 (649bbdd9-a56d-40d3-9e4d-252405dde687): created successfully Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2e4ab8-8ee5-46dd-bd1a-d64d9df15246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (e9d4be0e-f2a9-47bf-84c8-6848f0647ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9264811b-af63-4a2e-a7c0-48a0dd89ca08 tempest-CreateVolumesFromImageTest-310005144 None] Created volume successfully. Aug 11 06:47:14 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 1073741824" returned: 0 in 0.513s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:14 devstack sudo[112756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 Aug 11 06:47:14 devstack sudo[112756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:14 devstack sudo[112756]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539" returned: 0 in 0.239s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3554f5a4-5cb6-4a72-9cfe-1a85e899bff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2600688c-4c85-468f-9d20-80956c680539', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a95ac8-b835-4feb-aa61-e9dd9433a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:14 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Volume volume-2600688c-4c85-468f-9d20-80956c680539 (2600688c-4c85-468f-9d20-80956c680539): created successfully Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a95ac8-b835-4feb-aa61-e9dd9433a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Flow 'volume_create_manager' (9da159e0-7c6c-41f6-981f-ac2f5dd13069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:14 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-40f04b6e-cd05-48b2-9cfc-a65da7e87450 tempest-CreateVolumesFromImageTest-310005144 None] Created volume successfully. Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:15 devstack sudo[112759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:15 devstack sudo[112759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:15 devstack sudo[112759]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.233s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-2600688c-4c85-468f-9d20-80956c680539-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-2600688c-4c85-468f-9d20-80956c680539-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-quobyte-2600688c-4c85-468f-9d20-80956c680539" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-2600688c-4c85-468f-9d20-80956c680539" acquired by "delete_volume" :: waited 0.013s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c14b68-9014-4492-b862-503543cdafba]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:15 devstack sudo[112762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 Aug 11 06:47:15 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:16 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:16 devstack sudo[112767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539 Aug 11 06:47:16 devstack sudo[112767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:16 devstack sudo[112767]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2600688c-4c85-468f-9d20-80956c680539" returned: 0 in 0.263s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-2600688c-4c85-468f-9d20-80956c680539" released by "delete_volume" :: held 0.653s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Created reservations ['7fe630b0-3acc-4745-8dc4-025781074bfb', '2f64283a-05c9-4038-876e-99ee447a33a9', '6b141367-f651-4408-8e81-52295ed6c0dd', '1c1f8505-2f8f-45ab-82a6-c00848b0bb6e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:16 devstack sudo[112770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:16 devstack sudo[112770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:16 devstack sudo[112770]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.294s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Deleted volume successfully. Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7fb967b6-7c9f-4bb3-822a-c9948d612014 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-2600688c-4c85-468f-9d20-80956c680539-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-649bbdd9-a56d-40d3-9e4d-252405dde687-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-649bbdd9-a56d-40d3-9e4d-252405dde687-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-quobyte-649bbdd9-a56d-40d3-9e4d-252405dde687" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-649bbdd9-a56d-40d3-9e4d-252405dde687" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b480c-cfcd-4793-9530-d30c14003ffb]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:17 devstack sudo[112773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 Aug 11 06:47:17 devstack sudo[112773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:17 devstack sudo[112773]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687" returned: 0 in 0.423s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:17 devstack sudo[112778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687 Aug 11 06:47:17 devstack sudo[112778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:17 devstack sudo[112778]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-649bbdd9-a56d-40d3-9e4d-252405dde687" returned: 0 in 0.272s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-649bbdd9-a56d-40d3-9e4d-252405dde687" released by "delete_volume" :: held 0.741s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Created reservations ['9230e808-96cb-492d-8f9b-863b24df9f4b', 'e4a69676-58df-4ef8-a865-233ba981dfe2', '8cff2ee1-c36c-4386-a371-0308a904454e', '6bac2fae-0b72-4ef4-8d8c-691373479c54'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:17 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:17 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-quobyte-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:18 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af8ae2-da52-4108-b549-06211817ce7d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:18 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Deleted volume successfully. Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2e856a61-6c49-47db-bea7-f832307b3f47 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-649bbdd9-a56d-40d3-9e4d-252405dde687-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:18 devstack sudo[112784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 Aug 11 06:47:18 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:18 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" returned: 0 in 0.395s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:18 devstack sudo[112789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8 Aug 11 06:47:18 devstack sudo[112789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:18 devstack sudo[112789]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8" released by "delete_volume" :: held 0.715s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Created reservations ['12fd2a5b-4b49-4328-a48f-6f53836b2fd9', '4d44d1d7-16e7-46fc-8638-b93e18f7f453', 'ee0b4683-9bb6-41b0-a5d5-f1672c9c627c', '64c96146-d6e0-43d4-9989-980349297673'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:18 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:18 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-703895c0-6078-477f-b2bb-35af68a4dd2c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-703895c0-6078-477f-b2bb-35af68a4dd2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-quobyte-703895c0-6078-477f-b2bb-35af68a4dd2c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:19 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.342s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-703895c0-6078-477f-b2bb-35af68a4dd2c" acquired by "delete_volume" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Deleted volume successfully. Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-0f7cca8f-d283-43e7-a27c-72105fbe94d4 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-8b4821ad-0e06-41fd-8c2f-69dd088ee1b8-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b0e3f-7ae7-48c0-8cb7-7539d0ec82a7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:19 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c Aug 11 06:47:19 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:19 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c" returned: 0 in 0.362s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:19 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c Aug 11 06:47:19 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:19 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-703895c0-6078-477f-b2bb-35af68a4dd2c" returned: 0 in 0.246s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-703895c0-6078-477f-b2bb-35af68a4dd2c" released by "delete_volume" :: held 0.665s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:19 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Created reservations ['faa7e0bc-d623-4d7f-b3a0-e68908527521', '0dbce10c-07c8-4f95-86c7-5f8767c92017', 'bd3f2752-e4c8-4792-bf92-076b19610cba', '53fc707f-a449-4fdc-9b36-3f3a8bbed24d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:20 devstack sudo[112840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:20 devstack sudo[112840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:20 devstack sudo[112840]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Deleted volume successfully. Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-baeba556-2ea5-4c71-82b3-db6b566c66ef tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-703895c0-6078-477f-b2bb-35af68a4dd2c-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-928a32df-9ac6-402d-b581-09be53e26916-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-928a32df-9ac6-402d-b581-09be53e26916-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "cinder-quobyte-928a32df-9ac6-402d-b581-09be53e26916" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-928a32df-9ac6-402d-b581-09be53e26916" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b1adbb-2de8-49cc-a6bb-7a52fda5abe4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:20 devstack sudo[112843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 Aug 11 06:47:20 devstack sudo[112843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:20 devstack sudo[112843]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916" returned: 0 in 0.366s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:20 devstack sudo[112854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916 Aug 11 06:47:20 devstack sudo[112854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:21 devstack sudo[112854]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-928a32df-9ac6-402d-b581-09be53e26916" returned: 0 in 0.255s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-quobyte-928a32df-9ac6-402d-b581-09be53e26916" released by "delete_volume" :: held 0.669s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Created reservations ['00670f24-c355-40d9-8653-18a78755861c', '413c91f3-811b-4bbb-9e3d-a246a914e656', 'b0d714bb-45f2-4d89-bbbc-ec4ec9aa6079', 'c597894a-3197-4602-b751-28b44244a9f9'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:21 devstack sudo[112857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:21 devstack sudo[112857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:21 devstack sudo[112857]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.256s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Deleted volume successfully. Aug 11 06:47:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-23321514-a009-48ce-ae58-3d28491e3802 tempest-CreateVolumesFromImageTest-310005144 None] Lock "cinder-928a32df-9ac6-402d-b581-09be53e26916-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (4f81647f-8125-46ab-97f0-3b5b9754637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0bf720-da6d-41d8-842d-4dd9af65a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0bf720-da6d-41d8-842d-4dd9af65a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411160449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82264f58-4ba0-4f5f-8ee3-f58d135a07de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:24Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41f5d5-3262-4d4b-9a66-33bb5769bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41f5d5-3262-4d4b-9a66-33bb5769bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33a838-42ad-4f41-b71e-4e291238d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db33a838-42ad-4f41-b71e-4e291238d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82264f58-4ba0-4f5f-8ee3-f58d135a07de', 'volume_name': 'volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cee00d6-93fc-4180-b564-0344fa952d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cee00d6-93fc-4180-b564-0344fa952d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1280e319-81d2-408f-8b8c-aa6546d2adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume 82264f58-4ba0-4f5f-8ee3-f58d135a07de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de', 'volume_size': 1} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1411160449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82264f58-4ba0-4f5f-8ee3-f58d135a07de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:24Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume 82264f58-4ba0-4f5f-8ee3-f58d135a07de {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:24 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:24 devstack sudo[112860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de 1073741824 Aug 11 06:47:24 devstack sudo[112860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:24 devstack sudo[112860]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de 1073741824" returned: 0 in 0.435s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:25 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de Aug 11 06:47:25 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:25 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de" returned: 0 in 0.258s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1280e319-81d2-408f-8b8c-aa6546d2adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b66353-8123-4fe1-9b6d-6e59a019b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de (82264f58-4ba0-4f5f-8ee3-f58d135a07de): created successfully Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b66353-8123-4fe1-9b6d-6e59a019b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (4f81647f-8125-46ab-97f0-3b5b9754637b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-919abbdb-9f2a-424e-b3a8-0af9bc6121d8 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (a2ad01a4-da6f-4216-82d5-994136e41442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce51217-2978-4037-a6c7-d53922cc7546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce51217-2978-4037-a6c7-d53922cc7546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837180025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fee578-e5e6-4479-b261-160f0faeac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:26Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432007a-94f3-4513-838a-5c5e10d3ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432007a-94f3-4513-838a-5c5e10d3ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1ebaad-6044-4746-a606-c1ae0adecf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1ebaad-6044-4746-a606-c1ae0adecf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9fee578-e5e6-4479-b261-160f0faeac41', 'volume_name': 'volume-d9fee578-e5e6-4479-b261-160f0faeac41', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef46052-9073-42c6-bb71-f475aa7ab2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef46052-9073-42c6-bb71-f475aa7ab2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f56785-11fd-48fb-9fcc-fbb7c8bd9e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume d9fee578-e5e6-4479-b261-160f0faeac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9fee578-e5e6-4479-b261-160f0faeac41', 'volume_size': 1} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837180025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fee578-e5e6-4479-b261-160f0faeac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:26Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume d9fee578-e5e6-4479-b261-160f0faeac41 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:26 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:26 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 1073741824 Aug 11 06:47:26 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (981eedd0-ca8c-494e-b10c-41a8a13bf3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac647938-91b8-4a16-9306-4f73b4bda75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac647938-91b8-4a16-9306-4f73b4bda75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647113679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:26Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e6fc6e-abee-47f4-96a2-4c05dc5ba03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e6fc6e-abee-47f4-96a2-4c05dc5ba03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0eef3d-19ee-42d4-b93f-638abc20c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0eef3d-19ee-42d4-b93f-638abc20c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa', 'volume_name': 'volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adcf7fa-1f3b-4d1d-80d2-4934d46253a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adcf7fa-1f3b-4d1d-80d2-4934d46253a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eedb000-174a-4de0-b759-b91425269856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume 9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa', 'volume_size': 1} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:26 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 1073741824" returned: 0 in 0.561s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:26 devstack sudo[112874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 Aug 11 06:47:26 devstack sudo[112874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (dc7de427-4367-4383-9325-444872a36b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662734b7-82d8-4612-a8e9-51900a171430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662734b7-82d8-4612-a8e9-51900a171430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046719468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89652581-75f3-49b5-8dfe-abb468807c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d8c0b4-7d5b-4dca-bada-3575b4a50e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d8c0b4-7d5b-4dca-bada-3575b4a50e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15452e92-f676-4aa1-ab6f-1eb2229b3ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15452e92-f676-4aa1-ab6f-1eb2229b3ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89652581-75f3-49b5-8dfe-abb468807c37', 'volume_name': 'volume-89652581-75f3-49b5-8dfe-abb468807c37', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716d756-1bae-411c-8c66-17c62f5da72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2716d756-1bae-411c-8c66-17c62f5da72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9efbac-bf41-4600-bc53-06daff750240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume 89652581-75f3-49b5-8dfe-abb468807c37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89652581-75f3-49b5-8dfe-abb468807c37', 'volume_size': 1} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:26 devstack sudo[112874]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41" returned: 0 in 0.302s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1647113679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:26Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume 9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:26 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f56785-11fd-48fb-9fcc-fbb7c8bd9e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fee578-e5e6-4479-b261-160f0faeac41', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:26 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa 1073741824 Aug 11 06:47:26 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4046eb-24f8-4e29-ae4b-f2344033cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-d9fee578-e5e6-4479-b261-160f0faeac41 (d9fee578-e5e6-4479-b261-160f0faeac41): created successfully Aug 11 06:47:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4046eb-24f8-4e29-ae4b-f2344033cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (a2ad01a4-da6f-4216-82d5-994136e41442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e2f6b0f2-ae8e-458f-b910-139c33dd9d33 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (2d9f1a77-9a9a-418c-b967-8b5eb13d39b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fdc8fa-1427-4873-a903-555925193123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fdc8fa-1427-4873-a903-555925193123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60325579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98173bb-9cc1-49f3-8d7d-fe2665817dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98173bb-9cc1-49f3-8d7d-fe2665817dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5206985b-6ac4-4524-8176-c7822d12d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5206985b-6ac4-4524-8176-c7822d12d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326', 'volume_name': 'volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e2298c-0f39-4b35-a9dc-b7b375641b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e2298c-0f39-4b35-a9dc-b7b375641b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c53fb56-9cb1-4e28-8509-56ae6bc9b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume 4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326', 'volume_size': 1} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:27 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa 1073741824" returned: 0 in 0.536s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:27 devstack sudo[112883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa Aug 11 06:47:27 devstack sudo[112883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (44b87398-0c0a-4257-8888-6ebe321357b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77597bbf-059f-4504-9618-5e09d7644cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77597bbf-059f-4504-9618-5e09d7644cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226906283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a1679e-ad77-4e11-828c-9ef8f2b98bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a31ce4c-132b-4217-bee6-03d1ae41cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a31ce4c-132b-4217-bee6-03d1ae41cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943fbb9-c537-45e0-8d5a-bf228c62605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1943fbb9-c537-45e0-8d5a-bf228c62605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a1679e-ad77-4e11-828c-9ef8f2b98bd8', 'volume_name': 'volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f2f4d4-f29d-428a-85ef-8d64fe4fce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f2f4d4-f29d-428a-85ef-8d64fe4fce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6242745-a327-4ec0-9a66-7c7510cd6ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume c2a1679e-ad77-4e11-828c-9ef8f2b98bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8', 'volume_size': 1} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:27 devstack sudo[112883]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" returned: 0 in 0.239s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046719468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89652581-75f3-49b5-8dfe-abb468807c37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume 89652581-75f3-49b5-8dfe-abb468807c37 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:27 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 1073741824 Aug 11 06:47:27 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eedb000-174a-4de0-b759-b91425269856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0b1e80-5c1b-4335-a6f8-14f16c3041d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa (9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa): created successfully Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0b1e80-5c1b-4335-a6f8-14f16c3041d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (981eedd0-ca8c-494e-b10c-41a8a13bf3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-cf4e324b-87e2-4ca4-84ee-15932acda754 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:28 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 1073741824" returned: 0 in 0.432s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:28 devstack sudo[112891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 Aug 11 06:47:28 devstack sudo[112891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:28 devstack sudo[112891]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-60325579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume 4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:28 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:28 devstack sudo[112894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 1073741824 Aug 11 06:47:28 devstack sudo[112894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9efbac-bf41-4600-bc53-06daff750240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89652581-75f3-49b5-8dfe-abb468807c37', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6840af79-7655-49aa-b12b-061c352bc414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-89652581-75f3-49b5-8dfe-abb468807c37 (89652581-75f3-49b5-8dfe-abb468807c37): created successfully Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6840af79-7655-49aa-b12b-061c352bc414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (dc7de427-4367-4383-9325-444872a36b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1cafdb12-02cd-4a78-9bf1-bdecbfb2f008 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:28 devstack sudo[112894]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 1073741824" returned: 0 in 0.446s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:29 devstack sudo[112900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 Aug 11 06:47:29 devstack sudo[112900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:29 devstack sudo[112900]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1226906283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a1679e-ad77-4e11-828c-9ef8f2b98bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af2d993defc495b89340816c213cf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:27Z,use_quota=True,user_id='fb3ce641b9184acdb9957f3b8ad218dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Creating volume c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:29 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c53fb56-9cb1-4e28-8509-56ae6bc9b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d9b509-c439-40ba-94f3-6381d84a2995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:29 devstack sudo[112903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 1073741824 Aug 11 06:47:29 devstack sudo[112903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:29 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 (4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326): created successfully Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d9b509-c439-40ba-94f3-6381d84a2995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (2d9f1a77-9a9a-418c-b967-8b5eb13d39b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-603535bb-f589-4530-be3e-1b6383335f76 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:29 devstack sudo[112903]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 1073741824" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:29 devstack sudo[112909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 Aug 11 06:47:29 devstack sudo[112909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:30 devstack sudo[112909]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" returned: 0 in 0.244s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6242745-a327-4ec0-9a66-7c7510cd6ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec61957-75c5-4084-b1c5-bd1ea3ec3cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:30 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Volume volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 (c2a1679e-ad77-4e11-828c-9ef8f2b98bd8): created successfully Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec61957-75c5-4084-b1c5-bd1ea3ec3cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Flow 'volume_create_manager' (44b87398-0c0a-4257-8888-6ebe321357b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-aae009b3-ac92-47a3-84af-a2336bab05f2 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created volume successfully. Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e66342-757c-407a-b796-21bfe8dbd5f8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:31 devstack sudo[112914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 Aug 11 06:47:31 devstack sudo[112914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:31 devstack sudo[112914]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:31 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8 Aug 11 06:47:31 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:31 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" returned: 0 in 0.245s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8" released by "delete_volume" :: held 0.666s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['6aa9ba70-efa9-45bf-854f-49c58ed206dd', '6a2f27ef-42c6-4026-b095-b125785fff75', '93275aaf-3c92-4895-8255-c9f091ae789d', 'd57e65ce-1860-4a41-ac2c-935e81d24088'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:31 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:31 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:32 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.258s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2845c9c6-da94-4e72-9585-6cd5582d84df tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-c2a1679e-ad77-4e11-828c-9ef8f2b98bd8-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[15663344-f61c-47cf-a1f0-a549b07ab7da]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:32 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 Aug 11 06:47:32 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:32 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" returned: 0 in 0.347s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:32 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326 Aug 11 06:47:32 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:32 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" returned: 0 in 0.243s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326" released by "delete_volume" :: held 0.629s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['2b43b690-cf5f-403a-9deb-f43281aca107', '665796a9-9f9b-4ad3-a078-cfd97557a5a0', '9084dd08-4aa4-462f-a82c-fe9df6eac785', 'cf926ba6-8aaf-4d53-abc5-5ee152dc01ce'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:32 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:32 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:33 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-62b833e7-7f9e-4601-97b6-b9d4b619880e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-4f71a5ca-99f8-4e5c-ace1-2f5d8f35a326-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-89652581-75f3-49b5-8dfe-abb468807c37-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-89652581-75f3-49b5-8dfe-abb468807c37-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-89652581-75f3-49b5-8dfe-abb468807c37" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-89652581-75f3-49b5-8dfe-abb468807c37" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3675245a-d5bd-423d-ba86-b4577b958343]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:33 devstack sudo[112936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 Aug 11 06:47:33 devstack sudo[112936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:33 devstack sudo[112936]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37" returned: 0 in 0.382s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:33 devstack sudo[112943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37 Aug 11 06:47:33 devstack sudo[112943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:34 devstack sudo[112943]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-89652581-75f3-49b5-8dfe-abb468807c37" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-89652581-75f3-49b5-8dfe-abb468807c37" released by "delete_volume" :: held 0.694s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['472b89ff-110b-4621-a24e-1d53ef60cd46', '15f2ed4c-2ce8-4577-8eb4-a6ff589e0eba', '648df9ed-ddf2-4508-ae43-36894e09981a', '749a6177-9dfc-4122-9de6-9a45d526ecdf'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:34 devstack sudo[112946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:34 devstack sudo[112946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:34 devstack sudo[112946]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.266s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c549ca64-c31b-4de0-a810-6b682645e000 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-89652581-75f3-49b5-8dfe-abb468807c37-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5256679-e57c-4c74-b5f6-1005929afc0a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:34 devstack sudo[112949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa Aug 11 06:47:34 devstack sudo[112949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:34 devstack sudo[112949]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:35 devstack sudo[112954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa Aug 11 06:47:35 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:35 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" returned: 0 in 0.242s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa" released by "delete_volume" :: held 0.639s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['a998f0bd-2876-4e68-b4d6-d9fa0009131a', '0430cd89-2c47-410d-a7ec-8a7edd412312', 'a053363d-f927-47b5-8676-e2ba112b8863', '10a74413-1dcd-4386-aa77-7ef6a8b62053'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:35 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:35 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:35 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-d9fee578-e5e6-4479-b261-160f0faeac41-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4514668c-afeb-4fb4-84fd-5a9b2f6811a0 tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-9cb29da7-03a5-43b1-8ccd-44f9d6a23eaa-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-d9fee578-e5e6-4479-b261-160f0faeac41-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-d9fee578-e5e6-4479-b261-160f0faeac41" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-d9fee578-e5e6-4479-b261-160f0faeac41" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e26eb2-d3a2-4c7b-8cbb-0b243556232d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:35 devstack sudo[112960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 Aug 11 06:47:35 devstack sudo[112960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:36 devstack sudo[112960]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:36 devstack sudo[112965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41 Aug 11 06:47:36 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:36 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-d9fee578-e5e6-4479-b261-160f0faeac41" returned: 0 in 0.253s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-d9fee578-e5e6-4479-b261-160f0faeac41" released by "delete_volume" :: held 0.670s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['a2f7e737-433e-4708-809f-0aaff7c6c657', '21f23711-bda6-4a97-a0df-4069e7251cac', 'dd6b2e1e-3f43-406b-8678-b75efae546b2', '8b6840c7-61fc-4237-897a-eff9e319eff1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:36 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:36 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:36 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:36 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-40f348c9-85f3-4cc8-9962-d52c0f7db29c tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-d9fee578-e5e6-4479-b261-160f0faeac41-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-82264f58-4ba0-4f5f-8ee3-f58d135a07de-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-82264f58-4ba0-4f5f-8ee3-f58d135a07de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "cinder-quobyte-82264f58-4ba0-4f5f-8ee3-f58d135a07de" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-82264f58-4ba0-4f5f-8ee3-f58d135a07de" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c346a1-faab-4120-a282-f3ac87ffbd66]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:37 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de Aug 11 06:47:37 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:37 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:37 devstack sudo[112976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de Aug 11 06:47:37 devstack sudo[112976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:37 devstack sudo[112976]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-82264f58-4ba0-4f5f-8ee3-f58d135a07de" returned: 0 in 0.239s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-quobyte-82264f58-4ba0-4f5f-8ee3-f58d135a07de" released by "delete_volume" :: held 0.651s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=182,cinder:SELECT=121,cinder:DELETE=17,cinder:INSERT=40 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=146,cinder:INSERT=48,cinder:UPDATE=181,cinder:DELETE=15 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Created reservations ['505e1e27-3d9b-4430-8720-405a4e28ef33', '2fcbd762-601d-4591-adff-1ba7c973017c', '060a10b3-dc41-4159-8022-fbd89c3f30bb', 'b0291625-f2f7-4bd8-81bc-290823774d3c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:37 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:37 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:37 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:37 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Deleted volume successfully. Aug 11 06:47:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8e9a31de-b6db-40b4-bca4-164fcb23440e tempest-CreateVolumesFromSourceVolumeTest-1710483745 None] Lock "cinder-82264f58-4ba0-4f5f-8ee3-f58d135a07de-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Flow 'volume_create_manager' (494e172e-d7ff-4a5f-9306-3f6668a8bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc62d1a-b7fe-48ae-85dc-1585a56f8409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc62d1a-b7fe-48ae-85dc-1585a56f8409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dc304d-95d1-4cc7-a7fb-6ceb854b9493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526ac07b8b04fe5b7feaada9a890838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:41Z,use_quota=True,user_id='965d1f0852bf45bbae799116a372e58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfdce0e-f5c6-463b-a31c-651e7518e8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfdce0e-f5c6-463b-a31c-651e7518e8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43daf28-5ca9-40cc-a653-2a5639d5e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43daf28-5ca9-40cc-a653-2a5639d5e092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dc304d-95d1-4cc7-a7fb-6ceb854b9493', 'volume_name': 'volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27da6314-ed31-4136-94ca-6c455775dfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27da6314-ed31-4136-94ca-6c455775dfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aba588-1674-4b84-a687-03d301b8d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:40 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Volume 80dc304d-95d1-4cc7-a7fb-6ceb854b9493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493', 'volume_size': 1} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dc304d-95d1-4cc7-a7fb-6ceb854b9493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526ac07b8b04fe5b7feaada9a890838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:41Z,use_quota=True,user_id='965d1f0852bf45bbae799116a372e58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Creating volume 80dc304d-95d1-4cc7-a7fb-6ceb854b9493 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:40 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:40 devstack sudo[112983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 1073741824 Aug 11 06:47:40 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:41 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 1073741824" returned: 0 in 0.443s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:41 devstack sudo[112988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 Aug 11 06:47:41 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:41 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" returned: 0 in 0.230s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68aba588-1674-4b84-a687-03d301b8d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f95d1d1-7113-4922-b938-fdda1279de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:41 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Volume volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 (80dc304d-95d1-4cc7-a7fb-6ceb854b9493): created successfully Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f95d1d1-7113-4922-b938-fdda1279de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:41 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Flow 'volume_create_manager' (494e172e-d7ff-4a5f-9306-3f6668a8bce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:41 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-41581b51-d5d6-43fc-924f-db3901cd13d8 tempest-CinderUnicodeTest-989559642 None] Created volume successfully. Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Flow 'volume_create_manager' (7b099225-a24e-4f45-a295-6ab7d7cf7b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb60536d-f123-4bd7-b05e-f626b7352dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb60536d-f123-4bd7-b05e-f626b7352dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1591425095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f879653e-1d20-4f97-a931-f542f9d07df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526ac07b8b04fe5b7feaada9a890838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:42Z,use_quota=True,user_id='965d1f0852bf45bbae799116a372e58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921e9319-bc8d-428b-9744-944c4ab7c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921e9319-bc8d-428b-9744-944c4ab7c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d52292-5041-4f5f-bdad-917680dca32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d52292-5041-4f5f-bdad-917680dca32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f879653e-1d20-4f97-a931-f542f9d07df9', 'volume_name': 'volume-f879653e-1d20-4f97-a931-f542f9d07df9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8115a75-0d1b-4283-aee3-f090366492ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8115a75-0d1b-4283-aee3-f090366492ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a3c1c1-918d-4e40-9592-e40fa1500476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:42 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Volume f879653e-1d20-4f97-a931-f542f9d07df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f879653e-1d20-4f97-a931-f542f9d07df9', 'volume_size': 1} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1591425095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f879653e-1d20-4f97-a931-f542f9d07df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3526ac07b8b04fe5b7feaada9a890838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:42Z,use_quota=True,user_id='965d1f0852bf45bbae799116a372e58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Creating volume f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:42 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:42 devstack sudo[112991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 1073741824 Aug 11 06:47:42 devstack sudo[112991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:42 devstack sudo[112991]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 1073741824" returned: 0 in 0.480s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:42 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 Aug 11 06:47:42 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:43 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9" returned: 0 in 0.242s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a3c1c1-918d-4e40-9592-e40fa1500476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f879653e-1d20-4f97-a931-f542f9d07df9', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187f23d7-125d-43a2-8f36-728beb358295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:43 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Volume volume-f879653e-1d20-4f97-a931-f542f9d07df9 (f879653e-1d20-4f97-a931-f542f9d07df9): created successfully Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187f23d7-125d-43a2-8f36-728beb358295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Flow 'volume_create_manager' (7b099225-a24e-4f45-a295-6ab7d7cf7b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-0e0b3351-bcc4-42ac-807e-ed8aa5718dfc tempest-CinderUnicodeTest-989559642 None] Created volume successfully. Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Creating offline snapshot b69beb9b-fd84-4b17-8769-0597a88eb766 of volume f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb7832-a21c-455d-8dac-5fa1a9f95e98]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:43 devstack sudo[112999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 Aug 11 06:47:43 devstack sudo[112999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:43 devstack sudo[112999]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9" returned: 0 in 0.361s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:43 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 1G Aug 11 06:47:43 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:44 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 1G" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879653e-1d20-4f97-a931-f542f9d07df9 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:44 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879653e-1d20-4f97-a931-f542f9d07df9 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 Aug 11 06:47:44 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:44 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879653e-1d20-4f97-a931-f542f9d07df9 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766" returned: 0 in 0.281s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:44 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 is being set with open permissions: ugo+rw Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:44 devstack sudo[113014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 Aug 11 06:47:44 devstack sudo[113014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:44 devstack sudo[113014]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766" returned: 0 in 0.238s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:44 devstack sudo[113017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info Aug 11 06:47:44 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:45 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info" returned: 0 in 0.240s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:45 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info is being set with open permissions: ugo+rw Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:45 devstack sudo[113020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info Aug 11 06:47:45 devstack sudo[113020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:45 devstack sudo[113020]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.info" returned: 0 in 0.255s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-073f2c94-581c-4dd6-9b05-ce6822ca6aa3 tempest-CinderUnicodeTest-989559642 None] Create snapshot completed successfully Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-b69beb9b-fd84-4b17-8769-0597a88eb766-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-b69beb9b-fd84-4b17-8769-0597a88eb766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-quobyte-b69beb9b-fd84-4b17-8769-0597a88eb766" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-b69beb9b-fd84-4b17-8769-0597a88eb766" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Deleting offline snapshot b69beb9b-fd84-4b17-8769-0597a88eb766 of volume f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] snapshot_file for this snap is: volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[30747c97-890c-4105-bb40-a3523e78673c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:45 devstack sudo[113023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 Aug 11 06:47:45 devstack sudo[113023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:46 devstack sudo[113023]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766" returned: 0 in 0.362s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f879653e-1d20-4f97-a931-f542f9d07df9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41480f3-fba4-4679-83cf-682b90d0567e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:46 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 Aug 11 06:47:46 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:46 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9" returned: 0 in 0.384s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:46 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 Aug 11 06:47:46 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:46 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766" returned: 0 in 0.376s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:46 devstack sudo[113038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766 Aug 11 06:47:46 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:47 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9.b69beb9b-fd84-4b17-8769-0597a88eb766" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-b69beb9b-fd84-4b17-8769-0597a88eb766" released by "_delete_snapshot" :: held 1.476s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" released by "delete_snapshot" :: held 1.498s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Created reservations ['308ed1f2-6544-4793-8ff2-6eec8eff0ebb', 'eafd6f2d-cb62-4f58-a8b4-3c94ca9c1d75', '7ca6aa45-f4ec-4aa0-b4f4-cecdd8d33175', 'ce52cd9d-d829-4cb5-859f-dc1e81091d72'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:47 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Delete snapshot completed successfully. Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c4c1a0a2-ddb3-4947-aa5a-b9e793997558 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-b69beb9b-fd84-4b17-8769-0597a88eb766-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-f879653e-1d20-4f97-a931-f542f9d07df9-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-f879653e-1d20-4f97-a931-f542f9d07df9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeadd393-4a3a-430c-9103-a82d08ec0071]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:48 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 Aug 11 06:47:48 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:48 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9" returned: 0 in 0.402s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:48 devstack sudo[113046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9 Aug 11 06:47:48 devstack sudo[113046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:48 devstack sudo[113046]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f879653e-1d20-4f97-a931-f542f9d07df9" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-f879653e-1d20-4f97-a931-f542f9d07df9" released by "delete_volume" :: held 0.763s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Created reservations ['9e0237fc-f2c0-48b7-b621-f16dfed771b0', '355aef60-0e2f-4105-afda-c76db795517f', 'aeff3f60-3b91-4c6f-b864-fc88530ad6fc', '22473793-9381-48d8-bc72-3758d5d94f8c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:48 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:48 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-80dc304d-95d1-4cc7-a7fb-6ceb854b9493-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-80dc304d-95d1-4cc7-a7fb-6ceb854b9493-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:49 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.306s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "cinder-quobyte-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Deleted volume successfully. Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-d8e0a63d-7c54-4f00-83fd-f739d15fd8a7 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-f879653e-1d20-4f97-a931-f542f9d07df9-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d385e8c-516c-4e72-9d1d-7cbee31dad30]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:49 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 Aug 11 06:47:49 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:49 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:49 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493 Aug 11 06:47:49 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:49 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-quobyte-80dc304d-95d1-4cc7-a7fb-6ceb854b9493" released by "delete_volume" :: held 0.704s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Created reservations ['0b8170a8-6b8d-4e60-898b-399becf4de22', '27aa36f6-6327-40e3-a33d-a6eda27f8d84', '4da54c2d-d9d5-4112-8f1e-7fd718f03be5', '2c350834-ae75-4380-9d80-24426b9a1c0b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:50 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:50 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:50 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:50 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Deleted volume successfully. Aug 11 06:47:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-54ec429b-5b23-456a-9bff-1b97cb841dc9 tempest-CinderUnicodeTest-989559642 None] Lock "cinder-80dc304d-95d1-4cc7-a7fb-6ceb854b9493-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (273ac64a-4240-4feb-9130-efe5afa81de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0d56da-dd26-4bb3-83e6-e316ada08381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d0d56da-dd26-4bb3-83e6-e316ada08381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639585906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:54Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19baa72e-b693-438c-9d94-f0433e2fff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19baa72e-b693-438c-9d94-f0433e2fff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db0c2b1-133a-4f07-ae36-189633963ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db0c2b1-133a-4f07-ae36-189633963ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2', 'volume_name': 'volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc9f6e7-2e91-442d-9ff5-9d67dee4e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc9f6e7-2e91-442d-9ff5-9d67dee4e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56269c31-6b88-4cc8-8289-ff7f6a9e7c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Volume 4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2', 'volume_size': 1} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639585906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:54Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Creating volume 4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:53 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:53 devstack sudo[113064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 1073741824 Aug 11 06:47:53 devstack sudo[113064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:54 devstack sudo[113064]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 1073741824" returned: 0 in 0.430s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:54 devstack sudo[113069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 Aug 11 06:47:54 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:54 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" returned: 0 in 0.249s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56269c31-6b88-4cc8-8289-ff7f6a9e7c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605f7b5e-512c-4ca7-930a-7db51f6e349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Volume volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 (4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2): created successfully Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605f7b5e-512c-4ca7-930a-7db51f6e349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (273ac64a-4240-4feb-9130-efe5afa81de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-74211634-3482-425a-8d2a-d91b04a9236b tempest-ProjectReaderTests-1793395209 None] Created volume successfully. Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "cinder-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-quobyte-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" acquired by "delete_volume" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f834ea6-86c5-4802-a94d-3d08f6f19fe2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:55 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 Aug 11 06:47:55 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:55 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" returned: 0 in 0.466s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:55 devstack sudo[113078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2 Aug 11 06:47:55 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:55 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2" released by "delete_volume" :: held 0.806s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:55 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Created reservations ['0c2e7020-f9d4-44a1-994b-5218e273d940', '6a33b5da-8847-4142-8a06-c858f4a486a9', 'de2d0976-5065-4586-a134-37b7f0412cb0', '0e027e52-fb1b-499b-a515-b51637e49eb5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:56 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:56 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:56 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:47:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Deleted volume successfully. Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e06dc4fd-af51-4191-a55d-7c81b709435e tempest-ProjectReaderTests-1793395209 None] Lock "cinder-4a4a5ad9-a932-4ef0-ba14-e0e21ced75c2-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (0f996590-4178-4b62-b0ed-d852e75eabaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced936af-4dce-40d1-947b-13c7b4da1e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced936af-4dce-40d1-947b-13c7b4da1e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139099394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507bb28f-c611-46c4-bc3b-7e2e5bd4587c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:57Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae37f21a-1500-43d4-86f4-67f16345aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae37f21a-1500-43d4-86f4-67f16345aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e599e274-428b-49c0-995a-f8dc8e78f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e599e274-428b-49c0-995a-f8dc8e78f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507bb28f-c611-46c4-bc3b-7e2e5bd4587c', 'volume_name': 'volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8f30f8-7c51-4f12-b93e-dbcb5cac6872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8f30f8-7c51-4f12-b93e-dbcb5cac6872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d3404f-0267-4106-a1f6-3b9c1a4bd7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Volume 507bb28f-c611-46c4-bc3b-7e2e5bd4587c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c', 'volume_size': 1} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139099394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507bb28f-c611-46c4-bc3b-7e2e5bd4587c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:47:57Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Creating volume 507bb28f-c611-46c4-bc3b-7e2e5bd4587c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:47:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:47:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:56 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c 1073741824 Aug 11 06:47:56 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:57 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c 1073741824" returned: 0 in 0.604s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:57 devstack sudo[113090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c Aug 11 06:47:57 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:57 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d3404f-0267-4106-a1f6-3b9c1a4bd7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddc6c92-c54c-4f80-aca8-ee1b4afef716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:47:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Volume volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c (507bb28f-c611-46c4-bc3b-7e2e5bd4587c): created successfully Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddc6c92-c54c-4f80-aca8-ee1b4afef716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:47:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (0f996590-4178-4b62-b0ed-d852e75eabaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:47:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d5cbfc31-cc10-4b6d-a0f8-416c65316f61 tempest-ProjectReaderTests-1793395209 None] Created volume successfully. Aug 11 06:47:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-507bb28f-c611-46c4-bc3b-7e2e5bd4587c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-507bb28f-c611-46c4-bc3b-7e2e5bd4587c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-quobyte-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:47:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f024496-01b1-4967-bbf4-1662b09ea8c9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:59 devstack sudo[113093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c Aug 11 06:47:59 devstack sudo[113093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:59 devstack sudo[113093]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" returned: 0 in 0.427s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:59 devstack sudo[113099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c Aug 11 06:47:59 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:47:59 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-507bb28f-c611-46c4-bc3b-7e2e5bd4587c" released by "delete_volume" :: held 0.769s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Created reservations ['bfbd6cc6-77e0-411a-97fb-b4e748f56d32', 'de26357c-9ace-4849-bfc9-68112f183e2d', '96ce1e54-8d0d-47f1-9644-00a36c648a71', 'cf81b63c-a486-4bac-b021-2f6de2c71fce'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:47:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:47:59 devstack sudo[113102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:47:59 devstack sudo[113102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:00 devstack sudo[113102]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.298s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Deleted volume successfully. Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b93f4fee-cac0-4034-ab31-1fbdbb700cb3 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-507bb28f-c611-46c4-bc3b-7e2e5bd4587c-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (dab5e142-aea8-449c-b8ae-2a1eda255406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132f895a-3da8-4126-b1e8-2e3e916e7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132f895a-3da8-4126-b1e8-2e3e916e7870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919183274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f85a8e-57c4-423d-aa2c-d5b9796244d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:01Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b4ee39-87b7-4362-897a-f0a588b19b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b4ee39-87b7-4362-897a-f0a588b19b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72001a8-2c02-4ada-a820-4acf3cb1e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72001a8-2c02-4ada-a820-4acf3cb1e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f85a8e-57c4-423d-aa2c-d5b9796244d1', 'volume_name': 'volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625e9319-61ed-46fe-9792-1854fd613e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625e9319-61ed-46fe-9792-1854fd613e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dcfabd-985e-4240-9032-d725b9a30b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Volume 15f85a8e-57c4-423d-aa2c-d5b9796244d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1', 'volume_size': 1} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919183274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f85a8e-57c4-423d-aa2c-d5b9796244d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:01Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Creating volume 15f85a8e-57c4-423d-aa2c-d5b9796244d1 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:00 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:00 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 1073741824 Aug 11 06:48:00 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:01 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 1073741824" returned: 0 in 0.504s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:01 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 Aug 11 06:48:01 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:01 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1" returned: 0 in 0.329s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55dcfabd-985e-4240-9032-d725b9a30b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe0865f-54b7-44ce-8b6e-df13d44ec92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Volume volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 (15f85a8e-57c4-423d-aa2c-d5b9796244d1): created successfully Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abe0865f-54b7-44ce-8b6e-df13d44ec92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (dab5e142-aea8-449c-b8ae-2a1eda255406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ba1815c2-6812-42ec-8a4c-a45fbd304caa tempest-ProjectReaderTests-1793395209 None] Created volume successfully. Aug 11 06:48:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-15f85a8e-57c4-423d-aa2c-d5b9796244d1-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "cinder-15f85a8e-57c4-423d-aa2c-d5b9796244d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-quobyte-15f85a8e-57c4-423d-aa2c-d5b9796244d1" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-15f85a8e-57c4-423d-aa2c-d5b9796244d1" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7340231c-a595-4248-9eae-c86af668afa4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:03 devstack sudo[113114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 Aug 11 06:48:03 devstack sudo[113114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:03 devstack sudo[113114]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:03 devstack sudo[113119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1 Aug 11 06:48:03 devstack sudo[113119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:03 devstack sudo[113119]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-15f85a8e-57c4-423d-aa2c-d5b9796244d1" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-15f85a8e-57c4-423d-aa2c-d5b9796244d1" released by "delete_volume" :: held 0.758s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Created reservations ['73dc0ca1-a651-48d9-8c70-b6461d027529', '856dd71c-b329-4617-88a6-3ac449b940b7', 'e24bf887-a956-436b-a671-9f957b50a41e', '1f77c637-bda5-452b-9375-b9e3517440e2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:04 devstack sudo[113122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:04 devstack sudo[113122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:04 devstack sudo[113122]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Deleted volume successfully. Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-507cb51e-798e-4219-b1d8-ce6d8ddaf11c tempest-ProjectReaderTests-1793395209 None] Lock "cinder-15f85a8e-57c4-423d-aa2c-d5b9796244d1-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (547d0618-83ae-4429-a127-b3dfe6460967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ef76ab-910b-4383-982f-534a0b0e8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ef76ab-910b-4383-982f-534a0b0e8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492224526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:05Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5752bc6d-7323-4c59-babe-ec1fa988a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5752bc6d-7323-4c59-babe-ec1fa988a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b7ea5f-e870-4cae-b28a-59d6700edb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b7ea5f-e870-4cae-b28a-59d6700edb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d', 'volume_name': 'volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62f610a-91d0-4091-a1ba-f4ef95e1374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62f610a-91d0-4091-a1ba-f4ef95e1374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a685f4-a2fa-4c3d-8ba6-916c4fc15112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Volume eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d', 'volume_size': 1} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492224526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cee7df5db94a4b96a20b6f13cc3c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:05Z,use_quota=True,user_id='a0e748654bd643ddba1fd46bdd86f6be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Creating volume eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:04 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:04 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d 1073741824 Aug 11 06:48:04 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:05 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d 1073741824" returned: 0 in 0.490s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:05 devstack sudo[113130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d Aug 11 06:48:05 devstack sudo[113130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:05 devstack sudo[113130]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" returned: 0 in 0.323s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a685f4-a2fa-4c3d-8ba6-916c4fc15112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ab7ca-eeea-40af-a892-38cbac3d1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:05 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Volume volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d (eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d): created successfully Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ab7ca-eeea-40af-a892-38cbac3d1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:05 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Flow 'volume_create_manager' (547d0618-83ae-4429-a127-b3dfe6460967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:05 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a91adba6-63fa-4225-851f-7b0170d69534 tempest-ProjectReaderTests-1793395209 None] Created volume successfully. Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "cinder-quobyte-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[508a5b43-f0b4-4dd7-b8e7-8d046fa3b3c9]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:06 devstack sudo[113133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d Aug 11 06:48:06 devstack sudo[113133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:07 devstack sudo[113133]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" returned: 0 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:07 devstack sudo[113138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d Aug 11 06:48:07 devstack sudo[113138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:07 devstack sudo[113138]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-quobyte-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d" released by "delete_volume" :: held 0.705s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:07 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Created reservations ['da04a45d-d978-455b-8136-82125fdac6e7', 'd58b92af-10eb-4f3a-8227-d64d6038a0b0', 'd3015507-def8-493a-b9c9-baad0b135741', '373ed162-e1eb-42f7-8be2-5f68c2712272'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:08 devstack sudo[113141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:08 devstack sudo[113141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:08 devstack sudo[113141]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:08 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:08 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Deleted volume successfully. Aug 11 06:48:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-084ddda9-b21c-4473-8022-e2a307fc35f7 tempest-ProjectReaderTests-1793395209 None] Lock "cinder-eceb6b93-90d7-4ee1-8dd9-fd86e8e5767d-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:15 devstack sudo[113146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:15 devstack sudo[113146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:15 devstack sudo[113146]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.296s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:48:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:48:17 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:INSERT=19,cinder:UPDATE=82,cinder:SELECT=55,cinder:DELETE=5 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:48:18 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=54,cinder:INSERT=20,cinder:UPDATE=80,cinder:DELETE=9 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (155a18f0-6b06-49ce-98bf-3791764dd31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b9d112-6ba8-417a-9201-6aeddee6b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b9d112-6ba8-417a-9201-6aeddee6b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870278111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54fdac3-c638-43b0-92e8-0cd59550d3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:25Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc54fc9-54ca-4716-9e72-14807940adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc54fc9-54ca-4716-9e72-14807940adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cff9d9-0a08-46ae-8af5-91f32c4bdac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cff9d9-0a08-46ae-8af5-91f32c4bdac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54fdac3-c638-43b0-92e8-0cd59550d3d1', 'volume_name': 'volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8030dd8-f3b4-4241-910b-098a71a1f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8030dd8-f3b4-4241-910b-098a71a1f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be1e2e2-d549-4857-a67a-ac65f732c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume e54fdac3-c638-43b0-92e8-0cd59550d3d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1', 'volume_size': 1} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-870278111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54fdac3-c638-43b0-92e8-0cd59550d3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:25Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume e54fdac3-c638-43b0-92e8-0cd59550d3d1 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:25 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:25 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 1073741824 Aug 11 06:48:25 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (684512f0-8c0b-4078-94c5-ea61a0032297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1289c24-7c7f-42ad-b150-69c934fefc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1289c24-7c7f-42ad-b150-69c934fefc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509320972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4254d85a-8328-43ca-ace5-dbbc5ca64130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:25Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316be523-1f93-4a34-bd89-a4f816b30810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316be523-1f93-4a34-bd89-a4f816b30810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b5cb4d-7c06-437b-a427-4eb40aa0a4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b5cb4d-7c06-437b-a427-4eb40aa0a4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4254d85a-8328-43ca-ace5-dbbc5ca64130', 'volume_name': 'volume-4254d85a-8328-43ca-ace5-dbbc5ca64130', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f19661f-3154-4b41-9786-afd3c5260389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f19661f-3154-4b41-9786-afd3c5260389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4afd2a-fda3-4853-b486-62f1f1c52100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Volume 4254d85a-8328-43ca-ace5-dbbc5ca64130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4254d85a-8328-43ca-ace5-dbbc5ca64130', 'volume_size': 1} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (35d99fe5-0242-49f2-8e32-e7208f0741d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a8857d-b0ef-4739-8be0-a85cc02dc0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a8857d-b0ef-4739-8be0-a85cc02dc0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160774833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6068d819-0236-4ba3-8740-1d12364787d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfba44d-23d0-473c-8fab-4c5d8e834559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfba44d-23d0-473c-8fab-4c5d8e834559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095d24a-4170-492b-864a-3243d97f03d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095d24a-4170-492b-864a-3243d97f03d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6068d819-0236-4ba3-8740-1d12364787d2', 'volume_name': 'volume-6068d819-0236-4ba3-8740-1d12364787d2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdf1268-4773-4cfb-8740-50ac7266304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdf1268-4773-4cfb-8740-50ac7266304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defae192-f32a-45c0-b766-6f940a15b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Volume 6068d819-0236-4ba3-8740-1d12364787d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6068d819-0236-4ba3-8740-1d12364787d2', 'volume_size': 1} Aug 11 06:48:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:26 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 1073741824" returned: 0 in 0.660s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:26 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 Aug 11 06:48:26 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Flow 'volume_create_manager' (e5bc05df-2ec2-4589-addf-b6d0ddbcdfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c996ad-a48b-452f-951a-c706b37fea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33c996ad-a48b-452f-951a-c706b37fea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-583699275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e71a8c-d367-4994-b344-ab93960c7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7f9dc6541d477ab560de2120f23b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='175f48ed2fa1443abde2714e9a3070f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999dc1b-4fe3-4f68-8dfa-867eb4f790e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999dc1b-4fe3-4f68-8dfa-867eb4f790e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9c4994-9b41-4575-ae97-ee6b91ce72af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9c4994-9b41-4575-ae97-ee6b91ce72af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e71a8c-d367-4994-b344-ab93960c7887', 'volume_name': 'volume-96e71a8c-d367-4994-b344-ab93960c7887', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b82b6-7153-4404-a8d7-20f1d3329ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (391b82b6-7153-4404-a8d7-20f1d3329ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cc0f9d-6887-4c4f-a670-4bcc99280e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Volume 96e71a8c-d367-4994-b344-ab93960c7887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e71a8c-d367-4994-b344-ab93960c7887', 'volume_size': 1} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (8615e834-c372-4cb2-aba6-3363356e6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40685084-1ff2-457d-9c6e-48f203726dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40685084-1ff2-457d-9c6e-48f203726dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-247797971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376668d8-95b7-42c0-af3e-4f9cd1227c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37a8c0-8205-4e96-860b-119e664df406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37a8c0-8205-4e96-860b-119e664df406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4952fff7-888c-42dd-8714-a83172b6b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4952fff7-888c-42dd-8714-a83172b6b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376668d8-95b7-42c0-af3e-4f9cd1227c8d', 'volume_name': 'volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555cc795-7ef4-4f19-a2f6-8e46052563bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555cc795-7ef4-4f19-a2f6-8e46052563bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236d2521-4721-4e82-a9e3-3da7c9f1d0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Volume 376668d8-95b7-42c0-af3e-4f9cd1227c8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d', 'volume_size': 1} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:26 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1" returned: 0 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509320972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4254d85a-8328-43ca-ace5-dbbc5ca64130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:25Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Creating volume 4254d85a-8328-43ca-ace5-dbbc5ca64130 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:26 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 1073741824 Aug 11 06:48:26 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be1e2e2-d549-4857-a67a-ac65f732c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9ac07d-4975-4ddb-be22-be2b58d95613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 (e54fdac3-c638-43b0-92e8-0cd59550d3d1): created successfully Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9ac07d-4975-4ddb-be22-be2b58d95613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (155a18f0-6b06-49ce-98bf-3791764dd31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (4db85791-c1d6-404b-bb09-6d4885490f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198748af-faef-4c3e-b331-81b54534081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5534f245-b69c-477d-b90c-956ddc6a2b49 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198748af-faef-4c3e-b331-81b54534081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006790792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dc9a2a-7813-4161-a988-e74870e3f2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:27Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ec1ebe-1c52-4d40-8372-f1db0e77ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ec1ebe-1c52-4d40-8372-f1db0e77ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d026774-8526-4d65-b502-f1593bd9f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d026774-8526-4d65-b502-f1593bd9f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05dc9a2a-7813-4161-a988-e74870e3f2ba', 'volume_name': 'volume-05dc9a2a-7813-4161-a988-e74870e3f2ba', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9595bb3-7061-4113-8f6c-c807a1e87d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9595bb3-7061-4113-8f6c-c807a1e87d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabfd771-5ff4-4300-92bd-b85cfa692595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:26 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Volume 05dc9a2a-7813-4161-a988-e74870e3f2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05dc9a2a-7813-4161-a988-e74870e3f2ba', 'volume_size': 1} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:26 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (677266f1-6894-4303-804f-a90664ab1627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f37b2d-994a-4927-b570-b7524ea792c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f37b2d-994a-4927-b570-b7524ea792c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521315966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ffa166-30e8-4e0d-9ece-447eec203183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:27Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945174ed-4277-4abd-80d7-4c9913d8d7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945174ed-4277-4abd-80d7-4c9913d8d7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b62c6e4-f096-40c9-8d2c-8968b8d91451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b62c6e4-f096-40c9-8d2c-8968b8d91451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ffa166-30e8-4e0d-9ece-447eec203183', 'volume_name': 'volume-54ffa166-30e8-4e0d-9ece-447eec203183', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a8bfd3-dcf7-42a6-9a21-d17d0a0e7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a8bfd3-dcf7-42a6-9a21-d17d0a0e7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fa5217-1a20-4e4d-9087-8e7c14d4b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Volume 54ffa166-30e8-4e0d-9ece-447eec203183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ffa166-30e8-4e0d-9ece-447eec203183', 'volume_size': 1} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:27 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 1073741824" returned: 0 in 0.690s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:27 devstack sudo[113244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 Aug 11 06:48:27 devstack sudo[113244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:27 devstack sudo[113244]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130" returned: 0 in 0.280s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.761s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160774833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6068d819-0236-4ba3-8740-1d12364787d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Creating volume 6068d819-0236-4ba3-8740-1d12364787d2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:27 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:27 devstack sudo[113247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 1073741824 Aug 11 06:48:27 devstack sudo[113247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4afd2a-fda3-4853-b486-62f1f1c52100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4254d85a-8328-43ca-ace5-dbbc5ca64130', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa850b06-74f4-4287-8560-453874b1da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Volume volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 (4254d85a-8328-43ca-ace5-dbbc5ca64130): created successfully Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa850b06-74f4-4287-8560-453874b1da16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (684512f0-8c0b-4078-94c5-ea61a0032297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (d309f8c2-09d5-465a-94e1-029f3fb033d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51d2f17-cfc3-49a3-b049-7b05550ed49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-72b67590-f214-4679-bc5a-653479ece6ff tempest-CreateVolumesFromImageTest-1345624283 None] Created volume successfully. Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51d2f17-cfc3-49a3-b049-7b05550ed49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752736004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a30807-ae2e-46b5-beda-c3958bec467b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:28Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70da7a39-423f-4b97-a289-7c61154f63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70da7a39-423f-4b97-a289-7c61154f63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a84ffdf-74ca-4d69-a446-6a5f51b6accc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a84ffdf-74ca-4d69-a446-6a5f51b6accc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a30807-ae2e-46b5-beda-c3958bec467b', 'volume_name': 'volume-85a30807-ae2e-46b5-beda-c3958bec467b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9cdd66-35a5-4c37-b0aa-7a8c579c5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9cdd66-35a5-4c37-b0aa-7a8c579c5c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9297caf4-835c-4492-b8e3-d16215cb2d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume 85a30807-ae2e-46b5-beda-c3958bec467b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a30807-ae2e-46b5-beda-c3958bec467b', 'volume_size': 1} Aug 11 06:48:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:28 devstack sudo[113247]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (7eb0619e-f0d2-4d5d-a253-6f14058a6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec212f74-f7d2-4dc1-b22b-64bd261ab051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 1073741824" returned: 0 in 0.631s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec212f74-f7d2-4dc1-b22b-64bd261ab051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055381105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e939eb-ca7a-4555-bffa-6aa325443dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:28Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4443da4-b70a-45f3-8720-cb612a77d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4443da4-b70a-45f3-8720-cb612a77d604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f2fa5f-ba93-4315-9c62-5458057fb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f2fa5f-ba93-4315-9c62-5458057fb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e939eb-ca7a-4555-bffa-6aa325443dd4', 'volume_name': 'volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7281d9b8-57fc-46cd-8f8f-bd78ef0b6843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7281d9b8-57fc-46cd-8f8f-bd78ef0b6843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a56c51-0bb1-4277-8687-b2d631b6b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume b7e939eb-ca7a-4555-bffa-6aa325443dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4', 'volume_size': 1} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:28 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 Aug 11 06:48:28 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:28 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.273s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-583699275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e71a8c-d367-4994-b344-ab93960c7887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7f9dc6541d477ab560de2120f23b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='175f48ed2fa1443abde2714e9a3070f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Creating volume 96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:28 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:28 devstack sudo[113256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 1073741824 Aug 11 06:48:28 devstack sudo[113256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (47a7ed78-9b47-4694-a8de-c4c51a364aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd2623-3ecc-44a6-86e2-16f3652f366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defae192-f32a-45c0-b766-6f940a15b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6068d819-0236-4ba3-8740-1d12364787d2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d0d98c-abd5-43d9-ab63-e59aab96218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffd2623-3ecc-44a6-86e2-16f3652f366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541077049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae459ad-602b-4c6b-9d2a-be25fddcaab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:29Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca945a4c-067b-47f1-8575-4699ad73aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca945a4c-067b-47f1-8575-4699ad73aff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d03977-1372-4f01-87ce-9ee4ecc397b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d03977-1372-4f01-87ce-9ee4ecc397b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae459ad-602b-4c6b-9d2a-be25fddcaab7', 'volume_name': 'volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc13468e-8b34-481b-b3ca-e8fd5d117827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc13468e-8b34-481b-b3ca-e8fd5d117827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5115537e-05ec-4773-8690-7078fa7db288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume 1ae459ad-602b-4c6b-9d2a-be25fddcaab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7', 'volume_size': 1} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:28 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Volume volume-6068d819-0236-4ba3-8740-1d12364787d2 (6068d819-0236-4ba3-8740-1d12364787d2): created successfully Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d0d98c-abd5-43d9-ab63-e59aab96218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:28 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (35d99fe5-0242-49f2-8e32-e7208f0741d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-51bff235-4f32-42ec-a743-3a4dde3ace6f tempest-CreateVolumesFromImageTest-1345624283 None] Created volume successfully. Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (7f721f98-e322-4c9d-be17-5543ea1b4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97b9a06-52a8-4c4f-afb7-86f733fc1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97b9a06-52a8-4c4f-afb7-86f733fc1a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076182057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6904c14c-568b-4989-a422-248e86d116b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:29Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c893d285-550a-4827-ab46-c73be06b78f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c893d285-550a-4827-ab46-c73be06b78f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690b7d25-4cd0-454d-9c61-f195d6336a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690b7d25-4cd0-454d-9c61-f195d6336a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6904c14c-568b-4989-a422-248e86d116b7', 'volume_name': 'volume-6904c14c-568b-4989-a422-248e86d116b7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fe3d97-73d3-4f25-956d-9d43273b1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fe3d97-73d3-4f25-956d-9d43273b1439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e348ce0-136c-4956-a66c-68ea4dd8bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume 6904c14c-568b-4989-a422-248e86d116b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6904c14c-568b-4989-a422-248e86d116b7', 'volume_size': 1} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:29 devstack sudo[113256]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 1073741824" returned: 0 in 0.676s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:29 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:29 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:29 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (c09c9a9f-84fb-4080-b6c8-82393135cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2fc921-46f1-465e-8fa3-a5fc6d923fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.340s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-247797971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376668d8-95b7-42c0-af3e-4f9cd1227c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:26Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Creating volume 376668d8-95b7-42c0-af3e-4f9cd1227c8d {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:29 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2fc921-46f1-465e-8fa3-a5fc6d923fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95510232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f0c2a5-f494-46e9-b0d5-9bdd76e32452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:30Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286bc58f-9ca0-45d7-a18e-5ba306d027d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d 1073741824 Aug 11 06:48:29 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286bc58f-9ca0-45d7-a18e-5ba306d027d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41a2f72-a0ab-420d-a780-040ab4886cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41a2f72-a0ab-420d-a780-040ab4886cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f0c2a5-f494-46e9-b0d5-9bdd76e32452', 'volume_name': 'volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dca6189-f691-414a-b740-a9ab12a2f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dca6189-f691-414a-b740-a9ab12a2f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106c78a6-cca8-4e7b-9aff-41f024ce6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume f7f0c2a5-f494-46e9-b0d5-9bdd76e32452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452', 'volume_size': 1} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cc0f9d-6887-4c4f-a670-4bcc99280e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e71a8c-d367-4994-b344-ab93960c7887', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ace61bc-1b37-4858-bf16-687ef1142228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:29 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Volume volume-96e71a8c-d367-4994-b344-ab93960c7887 (96e71a8c-d367-4994-b344-ab93960c7887): created successfully Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ace61bc-1b37-4858-bf16-687ef1142228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:29 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Flow 'volume_create_manager' (e5bc05df-2ec2-4589-addf-b6d0ddbcdfa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9e2bef5b-74a6-49b7-9809-3beb0b02e583 tempest-VolumeDependencyTests-1029945923 None] Created volume successfully. Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Flow 'volume_create_manager' (23488f70-30a8-465f-be75-3cefc0c8045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b1b3a-f889-49e7-9478-768664b78505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9b1b3a-f889-49e7-9478-768664b78505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba55ba2-8466-4440-9abd-0db385bb7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee44d322693f4377890bda45d6d99baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:30Z,use_quota=True,user_id='cf227cc570234f9a80e9a053731a21fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d72d8038-c83f-4a19-927a-70b612c9044c),volume_type_id=d72d8038-c83f-4a19-927a-70b612c9044c)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa36709-a001-4cba-a1f3-14c1bc9b70f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa36709-a001-4cba-a1f3-14c1bc9b70f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bd27c1-da16-4a4f-85e4-d859cf995895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:48:30 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d 1073741824" returned: 0 in 0.608s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:30 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d Aug 11 06:48:30 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bd27c1-da16-4a4f-85e4-d859cf995895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cba55ba2-8466-4440-9abd-0db385bb7ec1', 'volume_name': 'volume-cba55ba2-8466-4440-9abd-0db385bb7ec1', 'volume_size': 1, 'image_id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff8c5a3b90425147a806aaa819b71185', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee44d322693f4377890bda45d6d99baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a308f712dec4b03c198f373c76321546de4f058d7c2ed6387cdc4ecb9351cc0978c7fa1b778aca84ce5fe55c827ad65b38aa7e8aa24b7958f5553f42b8801ff', 'id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95ce0b-1336-4a25-8329-0177cc08244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df95ce0b-1336-4a25-8329-0177cc08244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c245a16a-f518-4197-ac9b-dad3583c4615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Volume cba55ba2-8466-4440-9abd-0db385bb7ec1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cba55ba2-8466-4440-9abd-0db385bb7ec1', 'volume_size': 1, 'image_id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff8c5a3b90425147a806aaa819b71185', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee44d322693f4377890bda45d6d99baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a308f712dec4b03c198f373c76321546de4f058d7c2ed6387cdc4ecb9351cc0978c7fa1b778aca84ce5fe55c827ad65b38aa7e8aa24b7958f5553f42b8801ff', 'id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Trying to clone cba55ba2-8466-4440-9abd-0db385bb7ec1 from image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:48:30 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d" returned: 0 in 0.374s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2006790792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05dc9a2a-7813-4161-a988-e74870e3f2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:27Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Creating volume 05dc9a2a-7813-4161-a988-e74870e3f2ba {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:30 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:30 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba 1073741824 Aug 11 06:48:30 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236d2521-4721-4e82-a9e3-3da7c9f1d0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2690d550-f632-494f-8674-0e84cab0a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:30 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Volume volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d (376668d8-95b7-42c0-af3e-4f9cd1227c8d): created successfully Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2690d550-f632-494f-8674-0e84cab0a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (8615e834-c372-4cb2-aba6-3363356e6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:48:30 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Image download 0.00 MB at 0.00 MB/s Aug 11 06:48:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-fd73e815-ce77-4855-9513-6c7d504df723 tempest-CreateVolumesFromImageTest-1345624283 None] Created volume successfully. Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc98aecf-16e5-428f-b548-c0305da0477a]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:31 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:31 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:31 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:31 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba 1073741824" returned: 0 in 0.514s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:31 devstack sudo[113286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba Aug 11 06:48:31 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:31 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:31 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:31 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba" returned: 0 in 0.274s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.499s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-521315966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ffa166-30e8-4e0d-9ece-447eec203183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18585fdacd0e4c7a9994b037de24d118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:27Z,use_quota=True,user_id='e0f43a2575fc4bd6956b8bd0e802c353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Creating volume 54ffa166-30e8-4e0d-9ece-447eec203183 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:31 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:31 devstack sudo[113291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 1073741824 Aug 11 06:48:31 devstack sudo[113291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabfd771-5ff4-4300-92bd-b85cfa692595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05dc9a2a-7813-4161-a988-e74870e3f2ba', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803873df-3dbb-489b-aae5-fa1cd89fd5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:31 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Volume volume-05dc9a2a-7813-4161-a988-e74870e3f2ba (05dc9a2a-7813-4161-a988-e74870e3f2ba): created successfully Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803873df-3dbb-489b-aae5-fa1cd89fd5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (4db85791-c1d6-404b-bb09-6d4885490f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Temporary image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 is fetched for user cf227cc570234f9a80e9a053731a21fc. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:48:31 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4813173d-9b59-4985-9e5a-3e58916d9b3e tempest-CreateVolumesFromImageTest-1345624283 None] Created volume successfully. Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2200a4-f33f-497d-a8e5-7b8a1aedf702]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:31 devstack sudo[113295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:31 devstack sudo[113295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:32 devstack sudo[113291]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 1073741824" returned: 0 in 0.537s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:32 devstack sudo[113295]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:32 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 Aug 11 06:48:32 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:32 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:32 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:32 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183" returned: 0 in 0.258s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.706s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752736004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a30807-ae2e-46b5-beda-c3958bec467b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:28Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume 85a30807-ae2e-46b5-beda-c3958bec467b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:32 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fa5217-1a20-4e4d-9087-8e7c14d4b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ffa166-30e8-4e0d-9ece-447eec203183', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:32 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b 1073741824 Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c133298-c0e1-426a-a3fe-45bd9d7b3af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:32 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Volume volume-54ffa166-30e8-4e0d-9ece-447eec203183 (54ffa166-30e8-4e0d-9ece-447eec203183): created successfully Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c133298-c0e1-426a-a3fe-45bd9d7b3af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Flow 'volume_create_manager' (677266f1-6894-4303-804f-a90664ab1627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:32 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-197b8808-28a1-489b-abb5-64a812f3ba3a tempest-CreateVolumesFromImageTest-1345624283 None] Created volume successfully. Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-54ffa166-30e8-4e0d-9ece-447eec203183-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-54ffa166-30e8-4e0d-9ece-447eec203183-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-quobyte-54ffa166-30e8-4e0d-9ece-447eec203183" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-54ffa166-30e8-4e0d-9ece-447eec203183" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[86641138-b75e-4a7e-a2af-759371525c59]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:32 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 Aug 11 06:48:32 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:32 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b 1073741824" returned: 0 in 0.511s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:33 devstack sudo[113317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b Aug 11 06:48:33 devstack sudo[113317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:33 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183" returned: 0 in 0.404s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:33 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183 Aug 11 06:48:33 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:33 devstack sudo[113317]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b" returned: 0 in 0.276s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.058s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055381105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e939eb-ca7a-4555-bffa-6aa325443dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:28Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume b7e939eb-ca7a-4555-bffa-6aa325443dd4 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:33 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9297caf4-835c-4492-b8e3-d16215cb2d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a30807-ae2e-46b5-beda-c3958bec467b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745230a5-5ba1-43c0-94a8-95bd215fbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:33 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 1073741824 Aug 11 06:48:33 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-85a30807-ae2e-46b5-beda-c3958bec467b (85a30807-ae2e-46b5-beda-c3958bec467b): created successfully Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745230a5-5ba1-43c0-94a8-95bd215fbce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (d309f8c2-09d5-465a-94e1-029f3fb033d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c82b2adf-5a44-4edb-8681-e20116c341cf tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:33 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-54ffa166-30e8-4e0d-9ece-447eec203183" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-54ffa166-30e8-4e0d-9ece-447eec203183" released by "delete_volume" :: held 0.713s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Created reservations ['b07b185e-6148-4c38-8395-d374f2e8d2a1', '29414367-10e3-4231-bdec-a3ab0a5226db', 'a1d69b92-cdcb-47c1-b88c-854fc04f24ee', '5229c2ff-712f-43fc-8312-c495053cc76a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:33 devstack sudo[113331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:33 devstack sudo[113331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:33 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 1073741824" returned: 0 in 0.550s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-05dc9a2a-7813-4161-a988-e74870e3f2ba-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:33 devstack sudo[113331]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.303s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:33 devstack sudo[113337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 Aug 11 06:48:33 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Deleted volume successfully. Aug 11 06:48:33 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-05dc9a2a-7813-4161-a988-e74870e3f2ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b2ed22d7-134a-45ab-bf28-eedb81affd59 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-54ffa166-30e8-4e0d-9ece-447eec203183-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-quobyte-05dc9a2a-7813-4161-a988-e74870e3f2ba" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-05dc9a2a-7813-4161-a988-e74870e3f2ba" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846fc91-8410-4eda-9045-04c67463c23f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:34 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba Aug 11 06:48:34 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:34 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4" returned: 0 in 0.270s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.440s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541077049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae459ad-602b-4c6b-9d2a-be25fddcaab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:29Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume 1ae459ad-602b-4c6b-9d2a-be25fddcaab7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:34 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a56c51-0bb1-4277-8687-b2d631b6b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:34 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 1073741824 Aug 11 06:48:34 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735f23d5-faa9-4d88-a983-6054ed66b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:34 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 (b7e939eb-ca7a-4555-bffa-6aa325443dd4): created successfully Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735f23d5-faa9-4d88-a983-6054ed66b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (7eb0619e-f0d2-4d5d-a253-6f14058a6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2934cb68-6596-4eb5-8556-b49a3b3decdb tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:34 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba" returned: 0 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:34 devstack sudo[113348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba Aug 11 06:48:34 devstack sudo[113348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:34 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 1073741824" returned: 0 in 0.515s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:34 devstack sudo[113348]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-05dc9a2a-7813-4161-a988-e74870e3f2ba" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-05dc9a2a-7813-4161-a988-e74870e3f2ba" released by "delete_volume" :: held 0.726s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:34 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 Aug 11 06:48:34 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Created reservations ['0a456207-c56b-4ec6-bad0-cc180b655b20', '1fbcde64-753d-4db4-86a8-c84fba73bc26', '2aa5c1f9-cc57-4697-a37e-23b3b321d529', 'e6ead130-94a0-4fc7-9108-7a0b4ba02553'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:34 devstack sudo[113355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:34 devstack sudo[113355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:35 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" returned: 0 in 0.332s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.983s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076182057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6904c14c-568b-4989-a422-248e86d116b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:29Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume 6904c14c-568b-4989-a422-248e86d116b7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:35 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-376668d8-95b7-42c0-af3e-4f9cd1227c8d-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:35 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 1073741824 Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5115537e-05ec-4773-8690-7078fa7db288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:35 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2253b37c-6245-4f33-b8d0-a7292475c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-376668d8-95b7-42c0-af3e-4f9cd1227c8d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:35 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 (1ae459ad-602b-4c6b-9d2a-be25fddcaab7): created successfully Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2253b37c-6245-4f33-b8d0-a7292475c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (47a7ed78-9b47-4694-a8de-c4c51a364aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:35 devstack sudo[113355]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-556d52a0-dfec-4769-9c1e-82ddea640989 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:35 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Deleted volume successfully. Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-quobyte-376668d8-95b7-42c0-af3e-4f9cd1227c8d" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-393ce4d9-14b1-49e4-b3b7-f173c1315ba9 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-05dc9a2a-7813-4161-a988-e74870e3f2ba-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-376668d8-95b7-42c0-af3e-4f9cd1227c8d" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[630513f4-f131-46c8-8ed6-38b08dd8a366]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:35 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d Aug 11 06:48:35 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:35 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 1073741824" returned: 0 in 0.500s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:35 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:35 devstack sudo[113369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 Aug 11 06:48:35 devstack sudo[113369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:35 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d Aug 11 06:48:35 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:35 devstack sudo[113369]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7" returned: 0 in 0.288s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.216s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-95510232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f0c2a5-f494-46e9-b0d5-9bdd76e32452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3690663c3d49499881a2b2050e4f0ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:30Z,use_quota=True,user_id='5dac5d15180f4f13b1df4a2691f3732a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Creating volume f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:35 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:36 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:36 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 1073741824 Aug 11 06:48:36 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e348ce0-136c-4956-a66c-68ea4dd8bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6904c14c-568b-4989-a422-248e86d116b7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd6e27e-47c5-4252-8573-204d69f61031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-376668d8-95b7-42c0-af3e-4f9cd1227c8d" returned: 0 in 0.344s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-376668d8-95b7-42c0-af3e-4f9cd1227c8d" released by "delete_volume" :: held 0.787s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:36 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-6904c14c-568b-4989-a422-248e86d116b7 (6904c14c-568b-4989-a422-248e86d116b7): created successfully Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd6e27e-47c5-4252-8573-204d69f61031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (7f721f98-e322-4c9d-be17-5543ea1b4069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:36 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1b779b97-7357-4c20-a723-dc9a102294f7 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Created reservations ['474c43ce-6a2e-4ad3-a12e-106f40da1607', 'ee3db0e3-36f7-439d-b62c-80491ef6c69f', 'b1ccaf13-6021-4b84-aba0-c3155282181b', '78ae0efe-0aeb-454b-8f4e-8ae748a3ee08'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:36 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:36 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-6068d819-0236-4ba3-8740-1d12364787d2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:36 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-6068d819-0236-4ba3-8740-1d12364787d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:36 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Deleted volume successfully. Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2d3bd1ef-8ac5-4b1f-a2ca-f30f157ef0e1 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-376668d8-95b7-42c0-af3e-4f9cd1227c8d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:36 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 1073741824" returned: 0 in 0.683s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-quobyte-6068d819-0236-4ba3-8740-1d12364787d2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-6068d819-0236-4ba3-8740-1d12364787d2" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0d3d2-94dc-4ed1-99ec-266276ea0379]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:36 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 Aug 11 06:48:36 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:36 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 Aug 11 06:48:36 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" returned: 0 in 0.273s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.433s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Creating offline snapshot fc54a06f-d193-47f6-bcf6-1fb06a9271e3 of volume 96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106c78a6-cca8-4e7b-9aff-41f024ce6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ceeb17-f7cd-4dac-bdd2-70b912add955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a6c30-c441-4147-b88d-7f8287aa216d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:37 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Volume volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 (f7f0c2a5-f494-46e9-b0d5-9bdd76e32452): created successfully Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ceeb17-f7cd-4dac-bdd2-70b912add955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Flow 'volume_create_manager' (c09c9a9f-84fb-4080-b6c8-82393135cc20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-aca9d1e9-9318-4e8c-869b-141e025e088e tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created volume successfully. Aug 11 06:48:37 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2" returned: 0 in 0.443s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:37 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2 Aug 11 06:48:37 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:37 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6068d819-0236-4ba3-8740-1d12364787d2" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-6068d819-0236-4ba3-8740-1d12364787d2" released by "delete_volume" :: held 0.783s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:37 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.466s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Created reservations ['86132137-efc8-4377-9f4f-fdc22138f7c6', '70f275f1-e135-4e75-861b-43159a183cba', 'dcd1bebb-c7f8-49b1-9e9d-4ae0d21ca037', 'b0003678-7a4d-4d87-97e6-ded1e6f06896'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:37 devstack sudo[113401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 1G Aug 11 06:48:37 devstack sudo[113401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a6833-515e-412d-b6ab-e3c6ec1ea6e7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:37 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:37 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-4254d85a-8328-43ca-ace5-dbbc5ca64130-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-4254d85a-8328-43ca-ace5-dbbc5ca64130-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:37 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 Aug 11 06:48:37 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "cinder-quobyte-4254d85a-8328-43ca-ace5-dbbc5ca64130" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-4254d85a-8328-43ca-ace5-dbbc5ca64130" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5161395-1f25-4db7-80c8-d5c3aa1ce0e1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Deleted volume successfully. Aug 11 06:48:38 devstack sudo[113410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 Aug 11 06:48:38 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-30968755-1b45-418f-9b06-6c8ac292e443 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-6068d819-0236-4ba3-8740-1d12364787d2-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:38 devstack sudo[113401]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 1G" returned: 0 in 0.692s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e71a8c-d367-4994-b344-ab93960c7887 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" returned: 0 in 0.523s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e71a8c-d367-4994-b344-ab93960c7887 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:38 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452 Aug 11 06:48:38 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130" returned: 0 in 0.428s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130 Aug 11 06:48:38 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" returned: 0 in 0.286s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452" released by "delete_volume" :: held 0.867s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:38 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e71a8c-d367-4994-b344-ab93960c7887 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.344s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 is being set with open permissions: ugo+rw Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:38 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['cbead2e4-ee7b-422b-bad1-39c7ce0ebcdc', '687bc4a7-b47d-4dcd-ac07-7cf86ade6931', 'cc2982d7-e51a-408a-997e-bc4bc6a9fdcb', '34fe7857-359e-411c-836b-4fcff69eeba6'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:38 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4254d85a-8328-43ca-ace5-dbbc5ca64130" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:38 devstack sudo[113435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:38 devstack sudo[113435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-quobyte-4254d85a-8328-43ca-ace5-dbbc5ca64130" released by "delete_volume" :: held 0.855s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-6904c14c-568b-4989-a422-248e86d116b7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-6904c14c-568b-4989-a422-248e86d116b7-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:38 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-6904c14c-568b-4989-a422-248e86d116b7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Created reservations ['80f5f959-edf2-47b2-9aec-a272e7634cb6', '0c1333a2-0761-421e-91d2-e9c5758ff7ca', 'b7964533-cb5b-4285-af59-4ba0eac73a13', '72b1d806-fd7f-4f5c-8adb-98ccae58a13f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-6904c14c-568b-4989-a422-248e86d116b7" acquired by "delete_volume" :: waited 0.078s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:39 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info Aug 11 06:48:39 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack sudo[113435]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2440ba9-889a-40ca-8992-307d46dd8204]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-99328952-581e-410a-a51e-ed42193ab36a tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-f7f0c2a5-f494-46e9-b0d5-9bdd76e32452-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:39 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack sudo[113441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 Aug 11 06:48:39 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info" returned: 0 in 0.307s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info is being set with open permissions: ugo+rw Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack sudo[113446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info Aug 11 06:48:39 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.291s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Deleted volume successfully. Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1564a515-20f3-409d-9bd6-a1c92aeec231 tempest-CreateVolumesFromImageTest-1345624283 None] Lock "cinder-4254d85a-8328-43ca-ace5-dbbc5ca64130-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:39 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7" returned: 0 in 0.508s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.info" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:39 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7 Aug 11 06:48:39 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.201s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba55ba2-8466-4440-9abd-0db385bb7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee44d322693f4377890bda45d6d99baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:30Z,use_quota=True,user_id='cf227cc570234f9a80e9a053731a21fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d72d8038-c83f-4a19-927a-70b612c9044c),volume_type_id=d72d8038-c83f-4a19-927a-70b612c9044c)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Creating volume cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:39 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:39 devstack sudo[113455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1073741824 Aug 11 06:48:39 devstack sudo[113455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b01c8ea0-ee86-4a71-b8ca-c0fceb2cd05f tempest-VolumeDependencyTests-1029945923 None] Create snapshot completed successfully Aug 11 06:48:39 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6904c14c-568b-4989-a422-248e86d116b7" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-6904c14c-568b-4989-a422-248e86d116b7" released by "delete_volume" :: held 0.869s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['d664fdbd-e36c-4252-aa36-8829c00ba508', '362a538b-abc7-415f-8ea3-abc41c5fd99f', 'efe767f9-b68a-4447-ad31-8604bc98656f', '55bd8032-60fa-4291-89bc-3403423c62e9'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:40 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:40 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:40 devstack sudo[113455]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1073741824" returned: 0 in 0.726s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:40 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.309s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46a299b9-0259-44ab-a647-e9dc534c1306 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-6904c14c-568b-4989-a422-248e86d116b7-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:40 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 Aug 11 06:48:40 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:40 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Flow 'volume_create_manager' (9c12dda0-eb4b-4991-9c2b-bcc2d8f56384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2387f160-e527-4a59-9fe6-770f1c7371bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2387f160-e527-4a59-9fe6-770f1c7371bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1787490832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19248d0c-8f91-4ecd-8536-d0169e9a8544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e7f9dc6541d477ab560de2120f23b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc54a06f-d193-47f6-bcf6-1fb06a9271e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:41Z,use_quota=True,user_id='175f48ed2fa1443abde2714e9a3070f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6a5874-20f8-4f7f-ae59-ccb01926de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6a5874-20f8-4f7f-ae59-ccb01926de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d386a26-0903-4343-93d2-3ba41a044766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d386a26-0903-4343-93d2-3ba41a044766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '19248d0c-8f91-4ecd-8536-d0169e9a8544', 'volume_name': 'volume-19248d0c-8f91-4ecd-8536-d0169e9a8544', 'volume_size': 1, 'snapshot_id': 'fc54a06f-d193-47f6-bcf6-1fb06a9271e3'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7c22d-3b33-4d34-aebd-385144c9e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7c22d-3b33-4d34-aebd-385144c9e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ec257-fce7-476f-a526-4f0e02e40e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:40 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Volume 19248d0c-8f91-4ecd-8536-d0169e9a8544: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-19248d0c-8f91-4ecd-8536-d0169e9a8544', 'volume_size': 1, 'snapshot_id': 'fc54a06f-d193-47f6-bcf6-1fb06a9271e3'} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-19248d0c-8f91-4ecd-8536-d0169e9a8544" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:40 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Attempting download of 24a75d02-bb4c-47d0-a5f6-061f5db988d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}])) to volume cba55ba2-8466-4440-9abd-0db385bb7ec1. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-19248d0c-8f91-4ecd-8536-d0169e9a8544" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Creating volume 19248d0c-8f91-4ecd-8536-d0169e9a8544 from snapshot fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] snapshot: fc54a06f-d193-47f6-bcf6-1fb06a9271e3, volume: 19248d0c-8f91-4ecd-8536-d0169e9a8544, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866bdcd-0e86-4b92-8872-4845ee54ffde]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[82535555-89e8-4edd-bdee-dbab4da6e286]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-1ae459ad-602b-4c6b-9d2a-be25fddcaab7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-1ae459ad-602b-4c6b-9d2a-be25fddcaab7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:41 devstack sudo[113470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3 Aug 11 06:48:41 devstack sudo[113470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:41 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:41 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e01aef-687d-4bdb-a3d0-2b2d92724a30]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:41 devstack sudo[113470]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3" returned: 0 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:41 devstack sudo[113474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 Aug 11 06:48:41 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:41 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96e71a8c-d367-4994-b344-ab93960c7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[13266cab-220d-4a43-9d79-be8600350dc6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:41 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3 Aug 11 06:48:41 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:41 devstack sudo[113483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:41 devstack sudo[113483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:41 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" returned: 0 in 0.565s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack sudo[113489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7 Aug 11 06:48:42 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:42 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3" returned: 1 in 0.478s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24a75d02-bb4c-47d0-a5f6-061f5db988d2_92ujn6f3' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9036a4-e696-4b53-ae2a-3986f0709c92]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:42 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:42 devstack sudo[113483]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.502s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack sudo[113499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 Aug 11 06:48:42 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:42 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" returned: 0 in 0.413s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-1ae459ad-602b-4c6b-9d2a-be25fddcaab7" released by "delete_volume" :: held 1.072s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:42 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['26178212-92aa-450e-b1ca-c78426538e9f', '1c30137b-3205-4af0-8de2-bdb6da79743e', '33161e2a-107f-48ed-a2c5-71545f4aa56a', 'b58d0408-38ee-4232-b475-6a748004d7ce'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:42 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD Aug 11 06:48:42 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack sudo[113509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:42 devstack sudo[113509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:42 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] 24a75d02-bb4c-47d0-a5f6-061f5db988d2 was raw, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:48:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:42 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 Aug 11 06:48:42 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:43 devstack sudo[113509]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-49988697-4511-453f-b3f9-b9c94feb1827 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-1ae459ad-602b-4c6b-9d2a-be25fddcaab7-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-b7e939eb-ca7a-4555-bffa-6aa325443dd4-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-b7e939eb-ca7a-4555-bffa-6aa325443dd4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-b7e939eb-ca7a-4555-bffa-6aa325443dd4" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-b7e939eb-ca7a-4555-bffa-6aa325443dd4" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e491077-8a6a-44b4-a59b-c80a135fb675]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:44 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 Aug 11 06:48:44 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:44 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1" returned: 0 in 1.604s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:44 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24a75d02-bb4c-47d0-a5f6-061f5db988d2_cz885euadevstack@QuobyteHD, size 0.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:48:44 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 06:48:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:44 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1G Aug 11 06:48:44 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:45 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4" returned: 0 in 1.109s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:45 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4 Aug 11 06:48:45 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:45 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 1G" returned: 0 in 1.214s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Downloaded image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}])) to volume cba55ba2-8466-4440-9abd-0db385bb7ec1 successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Temporary image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 for user cf227cc570234f9a80e9a053731a21fc is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Marking volume cba55ba2-8466-4440-9abd-0db385bb7ec1 as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Copying metadata from image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 to cba55ba2-8466-4440-9abd-0db385bb7ec1. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Creating volume glance metadata for volume cba55ba2-8466-4440-9abd-0db385bb7ec1 backed by image 24a75d02-bb4c-47d0-a5f6-061f5db988d2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff8c5a3b90425147a806aaa819b71185', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:48:45 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-b7e939eb-ca7a-4555-bffa-6aa325443dd4" returned: 0 in 0.802s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:45 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-b7e939eb-ca7a-4555-bffa-6aa325443dd4" released by "delete_volume" :: held 2.110s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (e77e50c8-dc05-48b8-b9ea-24bd30f01ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f9f0f-a526-4365-a9b9-a7ddb2c1abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8f9f0f-a526-4365-a9b9-a7ddb2c1abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163443634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b6171f-6dbc-416d-8a9c-7a7c18550bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:46Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5174dde4-ad76-4233-a878-1ee26adabea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5174dde4-ad76-4233-a878-1ee26adabea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fad4a2-eadf-49a6-b83a-f189ed87b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fad4a2-eadf-49a6-b83a-f189ed87b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b6171f-6dbc-416d-8a9c-7a7c18550bd2', 'volume_name': 'volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada63432-ddb3-422a-8d18-012bd60db2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada63432-ddb3-422a-8d18-012bd60db2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdafb24-98a8-4bd9-90dd-1d4b4af939db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 41b6171f-6dbc-416d-8a9c-7a7c18550bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2', 'volume_size': 1} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c245a16a-f518-4197-ac9b-dad3583c4615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba55ba2-8466-4440-9abd-0db385bb7ec1', 'volume_size': 1, 'image_id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff8c5a3b90425147a806aaa819b71185', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee44d322693f4377890bda45d6d99baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1a308f712dec4b03c198f373c76321546de4f058d7c2ed6387cdc4ecb9351cc0978c7fa1b778aca84ce5fe55c827ad65b38aa7e8aa24b7958f5553f42b8801ff', 'id': '24a75d02-bb4c-47d0-a5f6-061f5db988d2', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24a75d02-bb4c-47d0-a5f6-061f5db988d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1c150-517c-4d2c-bb3d-c10a92b8967e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['505bb3c1-96bd-4dc4-9475-488c73108f27', '13719a48-46cf-45eb-8c3e-08816f258e3f', 'eea51410-0dd9-4c32-b88e-854a87424999', '4b3210c8-6c73-4286-b9e1-7914b04227e4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Volume volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 (cba55ba2-8466-4440-9abd-0db385bb7ec1): created successfully Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6d1c150-517c-4d2c-bb3d-c10a92b8967e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Flow 'volume_create_manager' (23488f70-30a8-465f-be75-3cefc0c8045f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-76fade84-9ad6-40d3-b680-86c23026ae85 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Created volume successfully. Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:46 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:46 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Acquiring lock "cinder-cba55ba2-8466-4440-9abd-0db385bb7ec1-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "cinder-cba55ba2-8466-4440-9abd-0db385bb7ec1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Acquiring lock "cinder-quobyte-cba55ba2-8466-4440-9abd-0db385bb7ec1" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "cinder-quobyte-cba55ba2-8466-4440-9abd-0db385bb7ec1" acquired by "delete_volume" :: waited 0.036s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[62481a09-3268-4c65-9139-b27457cc2159]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:47 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.607s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:47 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ccc76c43-23d4-4d59-87d0-740c56d31a34 tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-b7e939eb-ca7a-4555-bffa-6aa325443dd4-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-85a30807-ae2e-46b5-beda-c3958bec467b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:47 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 Aug 11 06:48:47 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-85a30807-ae2e-46b5-beda-c3958bec467b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-85a30807-ae2e-46b5-beda-c3958bec467b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-85a30807-ae2e-46b5-beda-c3958bec467b" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6483fdd-5be0-455f-83c5-8aae19b2b159]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:48 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b Aug 11 06:48:48 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:48 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1" returned: 0 in 1.156s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:48 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1 Aug 11 06:48:48 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:48 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544" returned: 0 in 6.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:48:48 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Converted 1024.00 MB image at 162.12 MB/s Aug 11 06:48:48 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 is being set with open permissions: ugo+rw Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:48 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 Aug 11 06:48:48 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:48 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b" returned: 0 in 0.644s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:48 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b Aug 11 06:48:48 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:48 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-cba55ba2-8466-4440-9abd-0db385bb7ec1" returned: 0 in 0.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "cinder-quobyte-cba55ba2-8466-4440-9abd-0db385bb7ec1" released by "delete_volume" :: held 1.545s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:48 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" released by "_copy_volume_from_snapshot" :: held 7.823s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Created reservations ['a2937dc5-19e8-4361-a8a8-366de565f116', 'f28cb12a-9d5a-495c-805e-120767c720ab', 'a219fe41-d1d8-43f3-8355-5027c1eaa2b5', 'c2b046d6-d3f2-4c4c-ad26-00d5773ee76e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-19248d0c-8f91-4ecd-8536-d0169e9a8544" released by "_create_volume_from_snapshot" :: held 7.918s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.950s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:48 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1163443634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b6171f-6dbc-416d-8a9c-7a7c18550bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:46Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:48 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-85a30807-ae2e-46b5-beda-c3958bec467b" returned: 0 in 0.317s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:48 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 1073741824 Aug 11 06:48:48 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-85a30807-ae2e-46b5-beda-c3958bec467b" released by "delete_volume" :: held 1.122s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ec257-fce7-476f-a526-4f0e02e40e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19248d0c-8f91-4ecd-8536-d0169e9a8544', 'volume_size': 1, 'snapshot_id': 'fc54a06f-d193-47f6-bcf6-1fb06a9271e3'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a308aee0-e84e-4043-a2b5-4b49dddb62d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Volume volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 (19248d0c-8f91-4ecd-8536-d0169e9a8544): created successfully Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a308aee0-e84e-4043-a2b5-4b49dddb62d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Flow 'volume_create_manager' (9c12dda0-eb4b-4991-9c2b-bcc2d8f56384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:49 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:49 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2cd94bad-31ef-42c8-be38-c6688f306191 tempest-VolumeDependencyTests-1029945923 None] Created volume successfully. Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['0a0f5b26-ff77-4ee6-bf07-d0ea4f7f2516', 'bffc5b7c-1abd-452a-9e5d-39d03cea334d', '0b08f07b-fbf5-453c-a91e-fb680d8d916b', '4c4876fd-315f-48fa-b1a4-b9b10e0b326f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:49 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:49 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:49 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Deleted volume successfully. Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-67520d50-8404-4ddc-9651-c0821a727113 tempest-VolumeAndVolumeTypeFromImageTest-725760273 None] Lock "cinder-cba55ba2-8466-4440-9abd-0db385bb7ec1-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:49 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.330s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:49 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 1073741824" returned: 0 in 0.653s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3b4714ef-f1f5-4c94-86bc-5bab9ca4d3fa tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-85a30807-ae2e-46b5-beda-c3958bec467b-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:49 devstack sudo[113577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 Aug 11 06:48:49 devstack sudo[113577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:49 devstack sudo[113577]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdafb24-98a8-4bd9-90dd-1d4b4af939db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015cfdc9-2f44-48b8-ab20-d6c6eed792bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 (41b6171f-6dbc-416d-8a9c-7a7c18550bd2): created successfully Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015cfdc9-2f44-48b8-ab20-d6c6eed792bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (e77e50c8-dc05-48b8-b9ea-24bd30f01ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-260f355f-f77e-4029-980e-a58e94ed57ee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-e54fdac3-c638-43b0-92e8-0cd59550d3d1-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-e54fdac3-c638-43b0-92e8-0cd59550d3d1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Deleting offline snapshot fc54a06f-d193-47f6-bcf6-1fb06a9271e3 of volume 96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] snapshot_file for this snap is: volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "cinder-quobyte-e54fdac3-c638-43b0-92e8-0cd59550d3d1" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d24da8-ccc8-498b-a227-866a020a8097]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-e54fdac3-c638-43b0-92e8-0cd59550d3d1" acquired by "delete_volume" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[146df44d-ea63-4d51-be69-632ddaf4de7c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:50 devstack sudo[113581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:50 devstack sudo[113581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:50 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 Aug 11 06:48:50 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating offline snapshot a2705f1b-b3a5-42c6-ab8e-fde3a77857fb of volume 41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a90c02a-2d1f-473a-8707-dad672cc173d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:50 devstack sudo[113581]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.475s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96e71a8c-d367-4994-b344-ab93960c7887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:48:50 devstack sudo[113585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 Aug 11 06:48:50 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a25ecb-3c96-4920-a4ba-0c916436b1c3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:50 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1" returned: 0 in 0.514s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:50 devstack sudo[113599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1 Aug 11 06:48:50 devstack sudo[113599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:50 devstack sudo[113598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:50 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:51 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:51 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb 1G Aug 11 06:48:51 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:51 devstack sudo[113599]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e54fdac3-c638-43b0-92e8-0cd59550d3d1" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-quobyte-e54fdac3-c638-43b0-92e8-0cd59550d3d1" released by "delete_volume" :: held 0.903s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Created reservations ['8fbeb2cd-94bb-4abd-98ce-781bb2df0a6d', '242fb134-cd98-43f8-bde8-113695181b54', 'deffd0b4-a41d-4ae7-a69f-11a5607b8d17', '16d47bf1-0610-4eef-9cb1-881a00b03f65'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:51 devstack sudo[113614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:51 devstack sudo[113614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:51 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.787s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:51 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:51 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:51 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb 1G" returned: 0 in 0.608s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:51 devstack sudo[113620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb Aug 11 06:48:51 devstack sudo[113620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:51 devstack sudo[113614]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.305s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:51 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Deleted volume successfully. Aug 11 06:48:51 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-17d39d47-3e60-4fa9-b971-d79a80eedd2c tempest-CreateVolumesFromSourceVolumeTest-160828608 None] Lock "cinder-e54fdac3-c638-43b0-92e8-0cd59550d3d1-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:52 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:52 devstack sudo[113626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3 Aug 11 06:48:52 devstack sudo[113626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:52 devstack sudo[113620]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" returned: 0 in 0.527s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:52 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb is being set with open permissions: ugo+rw Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:52 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb Aug 11 06:48:52 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:52 devstack sudo[113626]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887.fc54a06f-d193-47f6-bcf6-1fb06a9271e3" returned: 0 in 0.384s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-fc54a06f-d193-47f6-bcf6-1fb06a9271e3" released by "_delete_snapshot" :: held 2.308s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" released by "delete_snapshot" :: held 2.339s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:52 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:52 devstack sudo[113635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info Aug 11 06:48:52 devstack sudo[113635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Created reservations ['7884d9ee-322e-452e-b525-107fce039834', '5f0d1fb2-e7b5-4a77-a4f2-75c53a07261f', 'c1ff66b4-7fe0-4dfd-b8ec-ec9a25373fc3', '46ee989e-962e-43d7-b059-f93cd4482a23'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Delete snapshot completed successfully. Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f587a27f-56ce-4efc-a4a6-ac654b9e238b tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-fc54a06f-d193-47f6-bcf6-1fb06a9271e3-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:52 devstack sudo[113635]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info" returned: 0 in 0.371s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:52 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info is being set with open permissions: ugo+rw Aug 11 06:48:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:53 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info Aug 11 06:48:53 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:53 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.info" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.773s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:53 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c89b3e64-1053-4391-a0c7-4d4a81c810f4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Create snapshot completed successfully Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-96e71a8c-d367-4994-b344-ab93960c7887-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-96e71a8c-d367-4994-b344-ab93960c7887-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d144d-3475-470e-916a-ee3c0c1a69f1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:53 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:53 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:54 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.525s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:54 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887 Aug 11 06:48:54 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:54 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-96e71a8c-d367-4994-b344-ab93960c7887" returned: 0 in 0.312s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-96e71a8c-d367-4994-b344-ab93960c7887" released by "delete_volume" :: held 0.938s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (21bc565c-2bb5-467a-b334-5afd5f4dd36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85e66ff-c70c-4455-958b-11e56fe26d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85e66ff-c70c-4455-958b-11e56fe26d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1564624250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10509ac5-8867-4854-946f-7d726ad1d4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:55Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a2672d-2672-4f23-a8ea-38b79133c350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a2672d-2672-4f23-a8ea-38b79133c350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ae6d7a-efc9-46e9-9032-0010f081b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ae6d7a-efc9-46e9-9032-0010f081b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10509ac5-8867-4854-946f-7d726ad1d4df', 'volume_name': 'volume-10509ac5-8867-4854-946f-7d726ad1d4df', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19558614-b0ea-4517-937b-917e2dd26b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19558614-b0ea-4517-937b-917e2dd26b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6e3c55-e583-4039-bee1-76168516e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 10509ac5-8867-4854-946f-7d726ad1d4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10509ac5-8867-4854-946f-7d726ad1d4df', 'volume_size': 1} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1564624250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10509ac5-8867-4854-946f-7d726ad1d4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:55Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 10509ac5-8867-4854-946f-7d726ad1d4df {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:54 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Created reservations ['ceb105a0-d5c3-48e7-965b-2cf830909922', 'd26cb3d1-1322-471e-ba00-0b25f7cbc77a', '8c3ca445-eb89-4af1-813b-f64b9fef4992', 'f22508b4-f19a-49c2-9c59-e87aaa974d04'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:54 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df 1073741824 Aug 11 06:48:54 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:55 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:55 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (0e793e17-dec3-473f-bffd-1ef317c8e03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c2e5e8-8c32-4acb-8733-7c63aa447fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c2e5e8-8c32-4acb-8733-7c63aa447fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444889448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa44e47-6c4d-4555-91a0-d8c36236c92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:55Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73031b73-11ef-49c8-afad-f02ba9d72bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73031b73-11ef-49c8-afad-f02ba9d72bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985fb5-9138-40c4-9413-955294bebf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985fb5-9138-40c4-9413-955294bebf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa44e47-6c4d-4555-91a0-d8c36236c92b', 'volume_name': 'volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cccaad-207e-41c3-861e-b5c90003d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cccaad-207e-41c3-861e-b5c90003d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e3934f-88cc-469f-aad6-3e8b7f8e5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 6fa44e47-6c4d-4555-91a0-d8c36236c92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b', 'volume_size': 1} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:55 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Deleted volume successfully. Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b391f120-302d-402d-b0ba-488547d80945 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-96e71a8c-d367-4994-b344-ab93960c7887-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:55 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df 1073741824" returned: 0 in 0.754s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:55 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df Aug 11 06:48:55 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (8dcc2508-33f6-40e9-a660-47eb31900433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae70a5-90f0-4ea9-b789-e8ddfd5e2cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ae70a5-90f0-4ea9-b789-e8ddfd5e2cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003453480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c3b2d-55ea-4d83-987d-ea51d573202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:56Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553bd201-3a24-4205-9df6-ebf188a458ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553bd201-3a24-4205-9df6-ebf188a458ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1e0cd7-64b9-4423-ae6d-e3677fb93544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1e0cd7-64b9-4423-ae6d-e3677fb93544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4c3b2d-55ea-4d83-987d-ea51d573202d', 'volume_name': 'volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb84a2d-e6ab-4ab9-b056-b308db61b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb84a2d-e6ab-4ab9-b056-b308db61b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5f157a-f3d0-46c8-9423-f4df20eb8de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 1f4c3b2d-55ea-4d83-987d-ea51d573202d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d', 'volume_size': 1} Aug 11 06:48:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:56 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df" returned: 0 in 0.427s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.776s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444889448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa44e47-6c4d-4555-91a0-d8c36236c92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:55Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 6fa44e47-6c4d-4555-91a0-d8c36236c92b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6e3c55-e583-4039-bee1-76168516e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10509ac5-8867-4854-946f-7d726ad1d4df', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack sudo[113661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b 1073741824 Aug 11 06:48:56 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46181b22-14f0-474d-b038-bf9a35696605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-10509ac5-8867-4854-946f-7d726ad1d4df (10509ac5-8867-4854-946f-7d726ad1d4df): created successfully Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46181b22-14f0-474d-b038-bf9a35696605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (21bc565c-2bb5-467a-b334-5afd5f4dd36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-34473533-a836-419a-9ad1-962a793637a1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (99cd5e03-36ef-4312-8782-e4078422621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3238e99c-dfc1-4543-ad84-8054e2bd04c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-19248d0c-8f91-4ecd-8536-d0169e9a8544-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3238e99c-dfc1-4543-ad84-8054e2bd04c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-547638247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed4088e-9300-406b-bc85-82d2f7b3d17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:56Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74e799c-e8f5-48df-ba03-b4d16a46f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74e799c-e8f5-48df-ba03-b4d16a46f468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b852a66-e5a5-4055-b85e-33b5e1966f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b852a66-e5a5-4055-b85e-33b5e1966f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed4088e-9300-406b-bc85-82d2f7b3d17a', 'volume_name': 'volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceec49db-d777-45b9-a036-2e5f51a1d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceec49db-d777-45b9-a036-2e5f51a1d74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec5cd5-8f5e-4de4-9d66-a13c1cb8db53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 2ed4088e-9300-406b-bc85-82d2f7b3d17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a', 'volume_size': 1} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-19248d0c-8f91-4ecd-8536-d0169e9a8544-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0fe38-b453-4ad9-9367-e013d8b0f445]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:56 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Flow 'volume_create_manager' (fc798439-dd58-4ebd-8eea-6714d8a5b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4bd511-f269-402f-9c24-e8016700bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b 1073741824" returned: 0 in 0.840s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:56 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 Aug 11 06:48:56 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4bd511-f269-402f-9c24-e8016700bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e86cef-48ee-432f-815a-0f053bb2d8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a969a6841f554a16878530662f2f5e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:57Z,use_quota=True,user_id='68c9e12e238243d2bbacd8e5b9caeed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23757b9-c8a5-4f93-83b0-79e81b7948aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23757b9-c8a5-4f93-83b0-79e81b7948aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1bf09a-1d05-4c97-839c-e763f1c9c131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1bf09a-1d05-4c97-839c-e763f1c9c131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e86cef-48ee-432f-815a-0f053bb2d8f5', 'volume_name': 'volume-78e86cef-48ee-432f-815a-0f053bb2d8f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d190fa-3b03-48e0-8122-3ec7a669196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d190fa-3b03-48e0-8122-3ec7a669196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4789745-b8e0-4768-9a17-639a220fe441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Volume 78e86cef-48ee-432f-815a-0f053bb2d8f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e86cef-48ee-432f-815a-0f053bb2d8f5', 'volume_size': 1} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (21b6a257-6464-474e-92eb-4d158f08e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc743c-aa65-42e5-81b1-cc9a4a39b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc743c-aa65-42e5-81b1-cc9a4a39b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823871506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747b5e09-c3bb-43e7-b14f-18de0be8fb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:57Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62baa70e-bef8-4a74-85cc-bf4b9ebf81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62baa70e-bef8-4a74-85cc-bf4b9ebf81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d51352-8b55-46ea-87c5-c899df461dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d51352-8b55-46ea-87c5-c899df461dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747b5e09-c3bb-43e7-b14f-18de0be8fb36', 'volume_name': 'volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e519fe3b-8e52-44c5-86cc-1eb7b58c1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e519fe3b-8e52-44c5-86cc-1eb7b58c1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32752da-45dd-48a5-82dc-15946acc3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume 747b5e09-c3bb-43e7-b14f-18de0be8fb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36', 'volume_size': 1} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:57 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b Aug 11 06:48:57 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:57 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544" returned: 0 in 0.550s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:57 devstack sudo[113673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544 Aug 11 06:48:57 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:57 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b" returned: 0 in 0.308s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2003453480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4c3b2d-55ea-4d83-987d-ea51d573202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:56Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 1f4c3b2d-55ea-4d83-987d-ea51d573202d {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:57 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e3934f-88cc-469f-aad6-3e8b7f8e5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d 1073741824 Aug 11 06:48:57 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f86789-b67e-4007-a93e-cb5eb048be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b (6fa44e47-6c4d-4555-91a0-d8c36236c92b): created successfully Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f86789-b67e-4007-a93e-cb5eb048be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (0e793e17-dec3-473f-bffd-1ef317c8e03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-55004f00-7e35-4439-bc5d-383b8d5865c3 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:48:57 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-19248d0c-8f91-4ecd-8536-d0169e9a8544" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-quobyte-19248d0c-8f91-4ecd-8536-d0169e9a8544" released by "delete_volume" :: held 0.985s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Created reservations ['26207a74-7958-4c35-959f-da2700d5fca5', '54fd0bab-5013-400b-bb51-3ac753bba4c4', 'a0115c46-b908-42b4-a97e-1ed3ea1ba8e7', '213e9e68-599d-42e0-ba78-ab350703d62d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:57 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:48:57 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:58 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:48:58 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Deleted volume successfully. Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d 1073741824" returned: 0 in 0.685s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a77019d2-6ca7-47b2-8d95-32e295f98360 tempest-VolumeDependencyTests-1029945923 None] Lock "cinder-19248d0c-8f91-4ecd-8536-d0169e9a8544-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:58 devstack sudo[113687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d Aug 11 06:48:58 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:58 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d" returned: 0 in 0.249s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-547638247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed4088e-9300-406b-bc85-82d2f7b3d17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:56Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 2ed4088e-9300-406b-bc85-82d2f7b3d17a {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:58 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5f157a-f3d0-46c8-9423-f4df20eb8de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cec98-cb2e-45d8-95a7-8c1a8a076dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:58 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a 1073741824 Aug 11 06:48:58 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:58 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d (1f4c3b2d-55ea-4d83-987d-ea51d573202d): created successfully Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3cec98-cb2e-45d8-95a7-8c1a8a076dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:58 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (8dcc2508-33f6-40e9-a660-47eb31900433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-49e45294-0a60-4893-a480-48188c6d71d8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:48:59 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a 1073741824" returned: 0 in 0.546s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:59 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a Aug 11 06:48:59 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:59 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a" returned: 0 in 0.312s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e86cef-48ee-432f-815a-0f053bb2d8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a969a6841f554a16878530662f2f5e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:57Z,use_quota=True,user_id='68c9e12e238243d2bbacd8e5b9caeed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Creating volume 78e86cef-48ee-432f-815a-0f053bb2d8f5 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:48:59 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec5cd5-8f5e-4de4-9d66-a13c1cb8db53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:59 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 1073741824 Aug 11 06:48:59 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd7b2a0-26db-410a-ba84-24f8dc7f88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:48:59 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a (2ed4088e-9300-406b-bc85-82d2f7b3d17a): created successfully Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd7b2a0-26db-410a-ba84-24f8dc7f88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:48:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (99cd5e03-36ef-4312-8782-e4078422621c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:48:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d3a678d3-a617-4023-a35e-6c7ea75ab661 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:49:00 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 1073741824" returned: 0 in 0.622s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:00 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 Aug 11 06:49:00 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Flow 'volume_create_manager' (4264255d-1c1a-4438-84d5-ffc49cc6c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bc67a-ac1c-494b-9729-012cb0ef8c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8bc67a-ac1c-494b-9729-012cb0ef8c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b44f8b2-8b94-402b-9768-2abc6ae22cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5db26500bb402d8588861b499f62c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:00Z,use_quota=True,user_id='f1ed2e6fb183404e8be24c86dfec9907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558cc96b-d3b7-441a-b1b4-61ee7c5ba7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558cc96b-d3b7-441a-b1b4-61ee7c5ba7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ff354-cb9f-41d8-a323-783a26d07f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.image.glance [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Creating Keystone auth plugin from conf {{(pid=94463) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 11 06:49:00 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.303s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823871506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747b5e09-c3bb-43e7-b14f-18de0be8fb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc798ed90b49acb12ba34afba8c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:48:57Z,use_quota=True,user_id='aa2829a8ef3d414489dae9b980dc5846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Creating volume 747b5e09-c3bb-43e7-b14f-18de0be8fb36 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:00 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:00 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 1073741824 Aug 11 06:49:00 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4789745-b8e0-4768-9a17-639a220fe441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e86cef-48ee-432f-815a-0f053bb2d8f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b4ed1b-2cf4-4025-91d8-3709f5e921dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Volume volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 (78e86cef-48ee-432f-815a-0f053bb2d8f5): created successfully Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b4ed1b-2cf4-4025-91d8-3709f5e921dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Flow 'volume_create_manager' (fc798439-dd58-4ebd-8eea-6714d8a5b31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e25f5edd-4ca3-4f57-b15d-5612e8183267 tempest-CinderUnicodeTest-1434929540 None] Created volume successfully. Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455ff354-cb9f-41d8-a323-783a26d07f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b44f8b2-8b94-402b-9768-2abc6ae22cfa', 'volume_name': 'volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa', 'volume_size': 1, 'image_id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afa2ef02c638f0eba53510ff95a7a1e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc5db26500bb402d8588861b499f62c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c1aaa5da0a516f4b54859b16878172d65b754ea2f9e33519b8fffd05183d38a46d3458a323684f2ec6331d3709100d3d03d31df3f594cb1c0c9b48469cd6e29', 'id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37813e49-95d6-4003-9441-57f3715c8aa3/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66797762-6833-435d-8e7b-81f6aedaaff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66797762-6833-435d-8e7b-81f6aedaaff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d50f291-7d68-4013-9d88-23e8c5e9865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa', 'volume_size': 1, 'image_id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afa2ef02c638f0eba53510ff95a7a1e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc5db26500bb402d8588861b499f62c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c1aaa5da0a516f4b54859b16878172d65b754ea2f9e33519b8fffd05183d38a46d3458a323684f2ec6331d3709100d3d03d31df3f594cb1c0c9b48469cd6e29', 'id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37813e49-95d6-4003-9441-57f3715c8aa3/file', 'properties': {}}, 'image_service': } Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Trying to clone 4b44f8b2-8b94-402b-9768-2abc6ae22cfa from image 37813e49-95d6-4003-9441-57f3715c8aa3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}]). {{(pid=94463) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 11 06:49:00 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Image download 0.00 MB at 0.00 MB/s Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd045abd-51d5-422b-8540-52aa75775abb]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:01 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:01 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:01 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 1073741824" returned: 0 in 0.629s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:01 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 Aug 11 06:49:01 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:01 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32752da-45dd-48a5-82dc-15946acc3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3443e470-1f75-492e-a6a8-1f011bd945f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Volume volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 (747b5e09-c3bb-43e7-b14f-18de0be8fb36): created successfully Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3443e470-1f75-492e-a6a8-1f011bd945f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Flow 'volume_create_manager' (21b6a257-6464-474e-92eb-4d158f08e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5cfa64e3-9f5b-418c-bef4-e7112ecee9e8 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created volume successfully. Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Flow 'volume_create_manager' (ec13b906-de5e-42ca-94ea-8effbd3a1e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b87c3b9-9860-40ed-8deb-1db0c5cbb10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b87c3b9-9860-40ed-8deb-1db0c5cbb10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-787084372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8fde27-cb65-45a3-90c6-bfedfb23b700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a969a6841f554a16878530662f2f5e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:01Z,use_quota=True,user_id='68c9e12e238243d2bbacd8e5b9caeed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6917c5b4-ff4c-4428-8ec1-4a6a07364059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6917c5b4-ff4c-4428-8ec1-4a6a07364059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9263b5b1-27c0-45ee-b745-c8da350984a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9263b5b1-27c0-45ee-b745-c8da350984a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8fde27-cb65-45a3-90c6-bfedfb23b700', 'volume_name': 'volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:01 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1fb39e-d9f8-4fbf-aeaa-0704a29603d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1fb39e-d9f8-4fbf-aeaa-0704a29603d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348899e7-403c-42fc-a6f4-075dd62f1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Volume 1d8fde27-cb65-45a3-90c6-bfedfb23b700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700', 'volume_size': 1} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-787084372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8fde27-cb65-45a3-90c6-bfedfb23b700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a969a6841f554a16878530662f2f5e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:01Z,use_quota=True,user_id='68c9e12e238243d2bbacd8e5b9caeed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Creating volume 1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:01 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:01 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 1073741824 Aug 11 06:49:01 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:01 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Temporary image 37813e49-95d6-4003-9441-57f3715c8aa3 is fetched for user f1ed2e6fb183404e8be24c86dfec9907. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f515c-8fa6-4ce4-8031-c205633645c4]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:02 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:02 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:02 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 1073741824" returned: 0 in 0.526s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:02 devstack sudo[113735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 Aug 11 06:49:02 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:02 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:02 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:02 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-747b5e09-c3bb-43e7-b14f-18de0be8fb36-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:02 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-747b5e09-c3bb-43e7-b14f-18de0be8fb36-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700" returned: 0 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348899e7-403c-42fc-a6f4-075dd62f1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded54ec-a9ba-4b3a-b987-65541119bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:02 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Volume volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 (1d8fde27-cb65-45a3-90c6-bfedfb23b700): created successfully Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded54ec-a9ba-4b3a-b987-65541119bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Flow 'volume_create_manager' (ec13b906-de5e-42ca-94ea-8effbd3a1e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:02 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-747b5e09-c3bb-43e7-b14f-18de0be8fb36" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b44f8b2-8b94-402b-9768-2abc6ae22cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5db26500bb402d8588861b499f62c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:00Z,use_quota=True,user_id='f1ed2e6fb183404e8be24c86dfec9907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Creating volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:02 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:02 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1073741824 Aug 11 06:49:02 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-aca24528-3516-4e5e-9416-152bab5bb84e tempest-CinderUnicodeTest-1434929540 None] Created volume successfully. Aug 11 06:49:02 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-747b5e09-c3bb-43e7-b14f-18de0be8fb36" acquired by "delete_volume" :: waited 0.060s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6ee65-7d22-406f-8412-af887112e6c7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:02 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 Aug 11 06:49:02 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:03 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1073741824" returned: 0 in 0.570s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:03 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36" returned: 0 in 0.494s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:03 devstack sudo[113757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36 Aug 11 06:49:03 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:03 devstack sudo[113759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa Aug 11 06:49:03 devstack sudo[113759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (1aeeeff1-4c8f-4370-9487-0b8d393610fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a26b77-fce0-4ec4-a73b-3f4278c13bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a26b77-fce0-4ec4-a73b-3f4278c13bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567825374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67e1a05-54b1-4f6b-a90c-608a2313b7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:03Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f8262d-9a9d-47d1-a295-2def9d86726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f8262d-9a9d-47d1-a295-2def9d86726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63534cc-3762-4f97-a91a-ba9485b5df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63534cc-3762-4f97-a91a-ba9485b5df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67e1a05-54b1-4f6b-a90c-608a2313b7a0', 'volume_name': 'volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a62b6a-60ca-4367-ad7e-1af2836d1c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a62b6a-60ca-4367-ad7e-1af2836d1c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0faad1c0-86ed-4ca2-a71c-cb0b998c5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Volume f67e1a05-54b1-4f6b-a90c-608a2313b7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0', 'volume_size': 1} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:03 devstack sudo[113759]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:03 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" returned: 0 in 0.305s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567825374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67e1a05-54b1-4f6b-a90c-608a2313b7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:03Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Creating volume f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:03 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-747b5e09-c3bb-43e7-b14f-18de0be8fb36" returned: 0 in 0.387s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-747b5e09-c3bb-43e7-b14f-18de0be8fb36" released by "delete_volume" :: held 0.980s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:03 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 1073741824 Aug 11 06:49:03 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Attempting download of 37813e49-95d6-4003-9441-57f3715c8aa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}])) to volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff229567-ae2a-4d32-8cd6-1fa6bf64da91]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['03b3009f-a27d-4658-bb42-5d7446f3d2cd', 'e91a5fe4-2f50-47b6-ba08-014e0dc71f2e', 'e6b2c7bb-1b13-47fc-bb7a-1abe27dff324', '29d96023-9b86-4873-a208-f1e93d4a6405'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:04 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk Aug 11 06:49:04 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:04 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:04 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk" returned: 0 in 0.469s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:04 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.334s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:04 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 1073741824" returned: 0 in 0.647s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-96c0c396-f782-42ba-87e9-018bfddf8c8f tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-747b5e09-c3bb-43e7-b14f-18de0be8fb36-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:04 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 Aug 11 06:49:04 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk Aug 11 06:49:04 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:04 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk" returned: 1 in 0.347s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_37813e49-95d6-4003-9441-57f3715c8aa3_a0pycuuk' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c354d81-0fe1-42f9-b9ef-ea3845861ffd]: (4, 'raw') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0faad1c0-86ed-4ca2-a71c-cb0b998c5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4b56cd-d41e-478c-aad8-b0f2d0b89b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Creating offline snapshot 35ee7e8b-f294-4706-b192-6c35f3a68e62 of volume 1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:04 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Volume volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 (f67e1a05-54b1-4f6b-a90c-608a2313b7a0): created successfully Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4b56cd-d41e-478c-aad8-b0f2d0b89b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (1aeeeff1-4c8f-4370-9487-0b8d393610fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d463565-6aa8-4e5f-961f-2f7e28d43616]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-64b407e1-b597-4547-805f-278260eff375 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:49:04 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:04 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 Aug 11 06:49:04 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-2ed4088e-9300-406b-bc85-82d2f7b3d17a-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-2ed4088e-9300-406b-bc85-82d2f7b3d17a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-2ed4088e-9300-406b-bc85-82d2f7b3d17a" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-2ed4088e-9300-406b-bc85-82d2f7b3d17a" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[48495275-2e2f-48d2-ab74-2f7e6ffe0d8e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a Aug 11 06:49:05 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD Aug 11 06:49:05 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700" returned: 0 in 0.545s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 1G Aug 11 06:49:05 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] 37813e49-95d6-4003-9441-57f3715c8aa3 was raw, converting to qcow2 {{(pid=94463) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa Aug 11 06:49:05 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a" returned: 0 in 0.513s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a Aug 11 06:49:05 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 1G" returned: 0 in 0.515s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:05 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 Aug 11 06:49:05 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:05 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-2ed4088e-9300-406b-bc85-82d2f7b3d17a" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-2ed4088e-9300-406b-bc85-82d2f7b3d17a" released by "delete_volume" :: held 0.948s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['7f8a051d-3390-40b1-8b11-51321d35f4e7', '998ed26e-a8ae-41d8-bdac-abb36e25279b', 'ec5eee0e-2b4d-4999-95af-94821afc4a19', '8dd7e0c8-7303-46ac-9b7a-4d2192c2c871'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:06 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" returned: 0 in 0.698s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_37813e49-95d6-4003-9441-57f3715c8aa3_8it8tbdldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:49:06 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Converted 0.00 MB image at 0.00 MB/s Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:06 devstack sudo[113821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1G Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:06 devstack sudo[113821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:06 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 is being set with open permissions: ugo+rw Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:06 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:06 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:06 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 Aug 11 06:49:06 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:06 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:06 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62" returned: 0 in 0.277s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7d40f744-f734-4a4e-9009-c6cdac787baf tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-2ed4088e-9300-406b-bc85-82d2f7b3d17a-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:06 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info Aug 11 06:49:06 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:06 devstack sudo[113821]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa 1G" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Downloaded image 37813e49-95d6-4003-9441-57f3715c8aa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}])) to volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa successfully. {{(pid=94463) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Temporary image 37813e49-95d6-4003-9441-57f3715c8aa3 for user f1ed2e6fb183404e8be24c86dfec9907 is deleted. {{(pid=94463) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.volume_utils [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Marking volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa as bootable. {{(pid=94463) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Copying metadata from image 37813e49-95d6-4003-9441-57f3715c8aa3 to 4b44f8b2-8b94-402b-9768-2abc6ae22cfa. {{(pid=94463) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Creating volume glance metadata for volume 4b44f8b2-8b94-402b-9768-2abc6ae22cfa backed by image 37813e49-95d6-4003-9441-57f3715c8aa3 with: {'image_id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'afa2ef02c638f0eba53510ff95a7a1e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94463) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d50f291-7d68-4013-9d88-23e8c5e9865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa', 'volume_size': 1, 'image_id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/37813e49-95d6-4003-9441-57f3715c8aa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afa2ef02c638f0eba53510ff95a7a1e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc5db26500bb402d8588861b499f62c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c1aaa5da0a516f4b54859b16878172d65b754ea2f9e33519b8fffd05183d38a46d3458a323684f2ec6331d3709100d3d03d31df3f594cb1c0c9b48469cd6e29', 'id': '37813e49-95d6-4003-9441-57f3715c8aa3', 'created_at': datetime.datetime(2026, 8, 11, 4, 48, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 11, 4, 48, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/37813e49-95d6-4003-9441-57f3715c8aa3/file', 'properties': {}}, 'image_service': }' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22570e45-1cec-466a-83af-a5378d1cdf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:06 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Volume volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa (4b44f8b2-8b94-402b-9768-2abc6ae22cfa): created successfully Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22570e45-1cec-466a-83af-a5378d1cdf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Flow 'volume_create_manager' (4264255d-1c1a-4438-84d5-ffc49cc6c06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-05aadfb4-823f-4cc0-bd4b-00c81be2d5d9 tempest-VolumeImageDependencyTests-1633248418 None] Created volume successfully. Aug 11 06:49:06 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info is being set with open permissions: ugo+rw Aug 11 06:49:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:06 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info Aug 11 06:49:06 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:07 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.info" returned: 0 in 0.269s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.059s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-1f4c3b2d-55ea-4d83-987d-ea51d573202d-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Creating offline snapshot c05194bc-47ea-45e8-9352-b9143c1bd8eb of volume f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-1f4c3b2d-55ea-4d83-987d-ea51d573202d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ae14306b-5b1d-4ce1-b6da-e62a331f9763 tempest-CinderUnicodeTest-1434929540 None] Create snapshot completed successfully Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b84b76-5eb3-4fd5-889c-267b2ad3b232]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-1f4c3b2d-55ea-4d83-987d-ea51d573202d" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-1f4c3b2d-55ea-4d83-987d-ea51d573202d" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a0a61-12ed-495c-88c1-01f0ad8d614a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:07 devstack sudo[113838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 Aug 11 06:49:07 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:07 devstack sudo[113839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d Aug 11 06:49:07 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:07 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" returned: 0 in 0.420s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Acquiring lock "cinder-4b44f8b2-8b94-402b-9768-2abc6ae22cfa-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:07 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb 1G Aug 11 06:49:07 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "cinder-4b44f8b2-8b94-402b-9768-2abc6ae22cfa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Acquiring lock "cinder-quobyte-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "cinder-quobyte-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f85a3-a1b8-482a-a06a-e83a7620739a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:07 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d" returned: 0 in 0.497s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:07 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d Aug 11 06:49:07 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa Aug 11 06:49:08 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1f4c3b2d-55ea-4d83-987d-ea51d573202d" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-1f4c3b2d-55ea-4d83-987d-ea51d573202d" released by "delete_volume" :: held 0.858s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['d57d82c6-801d-489e-9929-ab9f4f051b9c', '1123157e-735a-4078-a899-cc46131bfb39', '160e9d39-82ec-4f61-bbb9-e1e348b90ec9', '782a2953-f96e-4d2b-b23b-2c1ea5d39e7e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:08 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb 1G" returned: 0 in 0.649s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" returned: 0 in 0.526s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:08 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb Aug 11 06:49:08 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack sudo[113863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa Aug 11 06:49:08 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-35ee7e8b-f294-4706-b192-6c35f3a68e62-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-35ee7e8b-f294-4706-b192-6c35f3a68e62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:08 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-quobyte-35ee7e8b-f294-4706-b192-6c35f3a68e62" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:08 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-35ee7e8b-f294-4706-b192-6c35f3a68e62" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Deleting offline snapshot 35ee7e8b-f294-4706-b192-6c35f3a68e62 of volume 1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] snapshot_file for this snap is: volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e970e-9035-4040-822d-c6710f21708b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:08 devstack sudo[113868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 Aug 11 06:49:08 devstack sudo[113868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" returned: 0 in 0.365s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb" returned: 0 in 0.401s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb is being set with open permissions: ugo+rw Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "cinder-quobyte-4b44f8b2-8b94-402b-9768-2abc6ae22cfa" released by "delete_volume" :: held 0.954s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:08 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:08 devstack sudo[113876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb Aug 11 06:49:08 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.328s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:08 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-35b19198-2c60-4100-99c1-d1525ac809d4 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-1f4c3b2d-55ea-4d83-987d-ea51d573202d-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:08 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Created reservations ['4e42283f-93e0-40e0-b85d-b1986bdd86a6', 'ca789a42-4fd7-4343-8031-7f8d6c0c6e42', '3c44d629-ef96-49e8-af5b-7c39ee55d627', 'ec8b85f8-f575-4a6d-8f49-5413a682bff4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack sudo[113878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:09 devstack sudo[113878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb" returned: 0 in 0.351s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack sudo[113868]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62" returned: 0 in 0.504s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bf6270-c497-4244-994d-d0b87132ddbd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack sudo[113886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info Aug 11 06:49:09 devstack sudo[113886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack sudo[113878]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.274s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Deleted volume successfully. Aug 11 06:49:09 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 Aug 11 06:49:09 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-e69dfcf5-ffeb-498a-8e84-85aac34b743f tempest-VolumeImageDependencyTests-1633248418 None] Lock "cinder-4b44f8b2-8b94-402b-9768-2abc6ae22cfa-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:09 devstack sudo[113886]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info" returned: 0 in 0.293s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info is being set with open permissions: ugo+rw Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack sudo[113891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info Aug 11 06:49:09 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-6fa44e47-6c4d-4555-91a0-d8c36236c92b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-6fa44e47-6c4d-4555-91a0-d8c36236c92b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-6fa44e47-6c4d-4555-91a0-d8c36236c92b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-6fa44e47-6c4d-4555-91a0-d8c36236c92b" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:09 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700" returned: 0 in 0.479s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9cb02-423c-4b80-b98c-fc0fd26b12fe]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:09 devstack sudo[113896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 Aug 11 06:49:09 devstack sudo[113896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b Aug 11 06:49:09 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:09 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.info" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.675s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:09 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d8da21dd-672e-463f-a380-62ecf4ab6a49 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:49:10 devstack sudo[113896]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:10 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62 Aug 11 06:49:10 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:10 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b" returned: 0 in 0.484s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:10 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b Aug 11 06:49:10 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-c05194bc-47ea-45e8-9352-b9143c1bd8eb-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-c05194bc-47ea-45e8-9352-b9143c1bd8eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-c05194bc-47ea-45e8-9352-b9143c1bd8eb" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-c05194bc-47ea-45e8-9352-b9143c1bd8eb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot c05194bc-47ea-45e8-9352-b9143c1bd8eb of volume f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468b3a2-719f-4224-b57a-56a9335f87a3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:10 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700.35ee7e8b-f294-4706-b192-6c35f3a68e62" returned: 0 in 0.352s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:10 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb Aug 11 06:49:10 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-35ee7e8b-f294-4706-b192-6c35f3a68e62" released by "_delete_snapshot" :: held 1.896s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:10 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" released by "delete_snapshot" :: held 1.936s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-6fa44e47-6c4d-4555-91a0-d8c36236c92b" returned: 0 in 0.339s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-6fa44e47-6c4d-4555-91a0-d8c36236c92b" released by "delete_volume" :: held 0.891s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Created reservations ['6adf87f7-ca8c-403c-ad3e-3dbead261b46', '93f43401-5208-4bc3-a0f8-e7eda015c81c', '40396000-bbe9-4586-bd65-8f0bd6c76146', '6d3324e8-93de-41c8-9696-aa770f497a20'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['1905a082-a6dc-413b-a703-b5559763350f', 'b3ceb504-9d60-412a-85cf-d026084d3b6e', '7a70afa0-0d21-4a5e-a9d1-29c1582d923a', '94661f79-c726-4786-ada2-4bfe4b1da906'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Delete snapshot completed successfully. Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-742d9e5c-ed4a-4011-a389-cae867b0e104 tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-35ee7e8b-f294-4706-b192-6c35f3a68e62-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:10 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb" returned: 0 in 0.547s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:10 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:10 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d11fa10-ae2c-4c1d-96cf-d3bfb4f45872]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:11 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 Aug 11 06:49:11 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:11 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1a2382aa-c515-4e3e-8d07-5111e5cdd9af tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-6fa44e47-6c4d-4555-91a0-d8c36236c92b-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:11 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" returned: 0 in 0.520s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:11 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb Aug 11 06:49:11 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-1d8fde27-cb65-45a3-90c6-bfedfb23b700-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-1d8fde27-cb65-45a3-90c6-bfedfb23b700-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-10509ac5-8867-4854-946f-7d726ad1d4df-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" acquired by "delete_volume" :: waited 0.032s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:12 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-10509ac5-8867-4854-946f-7d726ad1d4df-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb" returned: 0 in 0.601s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b4500e-a0c0-457e-bb45-019d167b2a34]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:12 devstack sudo[113934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb Aug 11 06:49:12 devstack sudo[113934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-10509ac5-8867-4854-946f-7d726ad1d4df" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-10509ac5-8867-4854-946f-7d726ad1d4df" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:12 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 Aug 11 06:49:12 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bacb87c-6d76-4674-93bd-d744a0c4cd1e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:12 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df Aug 11 06:49:12 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:12 devstack sudo[113934]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0.c05194bc-47ea-45e8-9352-b9143c1bd8eb" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-c05194bc-47ea-45e8-9352-b9143c1bd8eb" released by "_delete_snapshot" :: held 2.167s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" released by "delete_snapshot" :: held 2.203s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:12 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700" returned: 0 in 0.482s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Created reservations ['a5136300-5b61-4ef5-8fa0-f42a10d8b9c7', 'ea01b48a-77d2-4636-b820-704f8feb93fc', 'fbe36574-813c-4555-864b-f3b9ca1955e7', '8735a40d-9c55-4c90-98a8-61a95f0f50f0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:12 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700 Aug 11 06:49:12 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:49:12 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f3330a0-dbe3-4848-a516-59c2860bf8e3 tempest-ProjectMemberTests-478824 None] Lock "cinder-c05194bc-47ea-45e8-9352-b9143c1bd8eb-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df" returned: 0 in 0.471s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:12 devstack sudo[113949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df Aug 11 06:49:12 devstack sudo[113949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:12 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-1d8fde27-cb65-45a3-90c6-bfedfb23b700" returned: 0 in 0.341s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-1d8fde27-cb65-45a3-90c6-bfedfb23b700" released by "delete_volume" :: held 0.962s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:12 devstack sudo[113949]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-10509ac5-8867-4854-946f-7d726ad1d4df" returned: 0 in 0.310s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-10509ac5-8867-4854-946f-7d726ad1d4df" released by "delete_volume" :: held 0.846s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Created reservations ['085a964e-565e-4d43-98a9-880714da9a73', '21f6f80d-6d91-42fc-93d8-c80935b5aaed', '544a0efa-cd9e-48d3-b173-3081183d2a58', '0dc54841-9a2c-41f5-af84-05a4d1ca337f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['0b076081-8a4f-413f-bfe5-c696712e4877', 'a2be1ce8-d7f5-450b-8081-549deb1b8815', '754ff365-0df8-4d53-811a-1108ae1e6bbc', '067e8e5c-fb72-4756-a895-1b3754e86605'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:13 devstack sudo[113953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:13 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:13 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:13 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:13 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.331s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Deleted volume successfully. Aug 11 06:49:13 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.294s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-f67e1a05-54b1-4f6b-a90c-608a2313b7a0-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-13f4ee54-f599-4d96-acf6-aae6235c0cbf tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-1d8fde27-cb65-45a3-90c6-bfedfb23b700-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "cinder-f67e1a05-54b1-4f6b-a90c-608a2313b7a0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6e835c43-0538-4a3f-9697-d12d8fbe1fee tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-10509ac5-8867-4854-946f-7d726ad1d4df-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63042a-08ac-4303-85f9-395872d093a1]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:13 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 Aug 11 06:49:13 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-78e86cef-48ee-432f-815a-0f053bb2d8f5-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-78e86cef-48ee-432f-815a-0f053bb2d8f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:14 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" returned: 0 in 0.463s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:14 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0 Aug 11 06:49:14 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "cinder-quobyte-78e86cef-48ee-432f-815a-0f053bb2d8f5" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-78e86cef-48ee-432f-815a-0f053bb2d8f5" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cd51b5-663e-4b06-8983-03c6a72f9bb5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleting offline snapshot a2705f1b-b3a5-42c6-ab8e-fde3a77857fb of volume 41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] snapshot_file for this snap is: volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21df7a-4af2-4af9-a8fc-46dd46667897]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:14 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 Aug 11 06:49:14 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f67e1a05-54b1-4f6b-a90c-608a2313b7a0" released by "delete_volume" :: held 0.855s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4c183f95-16da-48d8-bec0-800e04774899 tempest-ProjectAdminTests-1694885139 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7507057189941, 'free_capacity_gb': 1775.7507057189941, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94463) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 11 06:49:14 devstack sudo[113968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb Aug 11 06:49:14 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Created reservations ['10b214f3-b3a2-4282-b496-e5a018c06244', 'f38e5898-f7dd-4f20-9dd7-f9f8a0d01ae2', 'a046a4ef-6a67-4281-9b1b-dfdf3990c3a5', 'f12197b5-5643-4696-9479-d82f56131a06'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:14 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:14 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5" returned: 0 in 0.599s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:14 devstack sudo[113980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5 Aug 11 06:49:14 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:14 devstack sudo[113980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" returned: 0 in 0.543s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[076e01f8-e522-4dca-9362-f273aa49b328]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:15 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.408s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:49:15 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:15 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-eae4b243-8dec-4452-bafd-e7bcd27d01b6 tempest-ProjectMemberTests-478824 None] Lock "cinder-f67e1a05-54b1-4f6b-a90c-608a2313b7a0-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:15 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 Aug 11 06:49:15 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:15 devstack sudo[113980]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-78e86cef-48ee-432f-815a-0f053bb2d8f5" returned: 0 in 0.517s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-quobyte-78e86cef-48ee-432f-815a-0f053bb2d8f5" released by "delete_volume" :: held 1.174s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:15 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.385s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Created reservations ['a716dab5-94d3-4710-a8ed-58e3a1134140', '762e0b88-440c-48ee-a836-dee78e6e5654', '2f2c4149-9316-4dcb-8fb1-6b415638db92', 'ca304ab5-c563-451f-8cdd-779ebdc34f25'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (000a62df-2b9c-48e4-a3fc-fc5a3143c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b38b53a-db78-4a30-b005-fc378394be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b38b53a-db78-4a30-b005-fc378394be66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1853505085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f452230c-ac61-466b-b9ff-cb86917d004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:15Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd93e6d4-867e-456f-992d-a3f21aa2a1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd93e6d4-867e-456f-992d-a3f21aa2a1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373c000e-5a87-49bd-9219-f1ecdf7434f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373c000e-5a87-49bd-9219-f1ecdf7434f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f452230c-ac61-466b-b9ff-cb86917d004f', 'volume_name': 'volume-f452230c-ac61-466b-b9ff-cb86917d004f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574e60a8-cd92-4d81-92ec-7e45437fd175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574e60a8-cd92-4d81-92ec-7e45437fd175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b515cb-d145-4b6c-b70a-6919f38e50cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:15 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Volume f452230c-ac61-466b-b9ff-cb86917d004f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f452230c-ac61-466b-b9ff-cb86917d004f', 'volume_size': 1} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1853505085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f452230c-ac61-466b-b9ff-cb86917d004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:15Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Creating volume f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:15 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:15 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" returned: 0 in 0.673s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:15 devstack sudo[113992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f 1073741824 Aug 11 06:49:15 devstack sudo[113992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:15 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb Aug 11 06:49:15 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:15 devstack sudo[113996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:15 devstack sudo[113996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:16 devstack sudo[113996]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.305s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Deleted volume successfully. Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8198e0b2-0c21-4ace-9e2b-361500f4afcd tempest-CinderUnicodeTest-1434929540 None] Lock "cinder-78e86cef-48ee-432f-815a-0f053bb2d8f5-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:16 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:16 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb Aug 11 06:49:16 devstack sudo[113992]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:16 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f 1073741824" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:16 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f Aug 11 06:49:16 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:16 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2.a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" returned: 0 in 0.369s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:16 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f" returned: 0 in 0.345s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb" released by "_delete_snapshot" :: held 2.232s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" released by "delete_snapshot" :: held 2.262s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b515cb-d145-4b6c-b70a-6919f38e50cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f452230c-ac61-466b-b9ff-cb86917d004f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd5ac04-4e24-46af-9429-162dc3af47bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:16 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Volume volume-f452230c-ac61-466b-b9ff-cb86917d004f (f452230c-ac61-466b-b9ff-cb86917d004f): created successfully Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd5ac04-4e24-46af-9429-162dc3af47bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (000a62df-2b9c-48e4-a3fc-fc5a3143c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b309218f-b389-4608-bb94-f80ad023c4c6 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['51f0996c-ecb5-4a2b-b043-28d52b5804d3', 'aad5f044-7355-4373-83d8-54ab5fa8acbf', '85712963-4faa-449d-8ed2-a45ce13955bd', '4e2f7f1e-fd13-473c-8f1d-edf12934ebe1'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:16 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Delete snapshot completed successfully. Aug 11 06:49:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1bc21b9c-50b2-4949-915c-cffe73db2fd1 tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-a2705f1b-b3a5-42c6-ab8e-fde3a77857fb-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-41b6171f-6dbc-416d-8a9c-7a7c18550bd2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-41b6171f-6dbc-416d-8a9c-7a7c18550bd2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7b9a1-0f8d-44c8-af09-e61d447bbc2b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:17 devstack sudo[114013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 Aug 11 06:49:17 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Creating offline snapshot b66f533c-f3d2-4251-9ac2-0a595966f033 of volume f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fd2cf7-04c9-404c-adc8-8b279f7db025]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:18 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f Aug 11 06:49:18 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:18 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" returned: 0 in 0.507s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:18 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2 Aug 11 06:49:18 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:18 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f" returned: 0 in 0.469s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:18 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 1G Aug 11 06:49:18 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:18 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" returned: 0 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-quobyte-41b6171f-6dbc-416d-8a9c-7a7c18550bd2" released by "delete_volume" :: held 0.952s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=219,cinder:UPDATE=303,cinder:INSERT=81,cinder:DELETE=27 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=215,cinder:UPDATE=279,cinder:DELETE=25,cinder:INSERT=75 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Created reservations ['39a203d8-7297-42ae-8542-4680c7384a7f', '5c23ca23-eb6b-4b99-9f56-00e948eb117d', '28c5bc4f-5c26-4de8-b6a4-f2db3e324ec8', '983529a9-f827-44a4-8321-f0b7de4d4c3e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:18 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:18 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:19 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 1G" returned: 0 in 0.597s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f452230c-ac61-466b-b9ff-cb86917d004f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:19 devstack sudo[114036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f452230c-ac61-466b-b9ff-cb86917d004f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 Aug 11 06:49:19 devstack sudo[114036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:19 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.327s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Deleted volume successfully. Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-22ef2f42-b341-4c1e-8ac0-102279ee374d tempest-CreateVolumesFromSnapshotTest-1123096856 None] Lock "cinder-41b6171f-6dbc-416d-8a9c-7a7c18550bd2-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:19 devstack sudo[114036]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f452230c-ac61-466b-b9ff-cb86917d004f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033" returned: 0 in 0.360s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:19 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 is being set with open permissions: ugo+rw Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:19 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 Aug 11 06:49:19 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:19 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033" returned: 0 in 0.252s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:19 devstack sudo[114045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info Aug 11 06:49:19 devstack sudo[114045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:19 devstack sudo[114045]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info" returned: 0 in 0.331s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:19 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info is being set with open permissions: ugo+rw Aug 11 06:49:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:20 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info Aug 11 06:49:20 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:20 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.info" returned: 0 in 0.315s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:20 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bfad20d1-2674-4dbc-b10b-54451a2c2495 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-b66f533c-f3d2-4251-9ac2-0a595966f033-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-b66f533c-f3d2-4251-9ac2-0a595966f033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-b66f533c-f3d2-4251-9ac2-0a595966f033" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-b66f533c-f3d2-4251-9ac2-0a595966f033" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot b66f533c-f3d2-4251-9ac2-0a595966f033 of volume f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39cd03f-1541-44c6-b105-4375475ad545]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:21 devstack sudo[114094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 Aug 11 06:49:21 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (de9e845a-96d6-4a44-a563-c7538578f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e2a01f-6ae3-4182-93c3-c714c2323b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e2a01f-6ae3-4182-93c3-c714c2323b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-599495001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c615e4-f0c0-48b9-9126-4f86116cc6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:22Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7626536b-0eda-452e-a755-d8d5084d5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7626536b-0eda-452e-a755-d8d5084d5f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2416286-0792-42a9-9d31-46b1be7d722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2416286-0792-42a9-9d31-46b1be7d722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c615e4-f0c0-48b9-9126-4f86116cc6db', 'volume_name': 'volume-62c615e4-f0c0-48b9-9126-4f86116cc6db', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c984ece-e185-4f4e-af3e-7e4f55b552dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c984ece-e185-4f4e-af3e-7e4f55b552dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:21 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b65f80-dc2b-46b7-a17b-b5ecadc4edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:21 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Volume 62c615e4-f0c0-48b9-9126-4f86116cc6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c615e4-f0c0-48b9-9126-4f86116cc6db', 'volume_size': 1} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-599495001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c615e4-f0c0-48b9-9126-4f86116cc6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:22Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Creating volume 62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:21 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033" returned: 0 in 0.571s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f452230c-ac61-466b-b9ff-cb86917d004f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:21 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db 1073741824 Aug 11 06:49:21 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843cfb5-6d71-450c-a2d9-69e24cbc2590]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:22 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f Aug 11 06:49:22 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:22 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db 1073741824" returned: 0 in 0.545s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:22 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f" returned: 0 in 0.538s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:22 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 Aug 11 06:49:22 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:22 devstack sudo[114113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db Aug 11 06:49:22 devstack sudo[114113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:22 devstack sudo[114113]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db" returned: 0 in 0.353s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:22 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033" returned: 0 in 0.399s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b65f80-dc2b-46b7-a17b-b5ecadc4edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c615e4-f0c0-48b9-9126-4f86116cc6db', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea409eef-d7db-4cb5-9e8d-6a9638fcb773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:22 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033 Aug 11 06:49:22 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:22 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Volume volume-62c615e4-f0c0-48b9-9126-4f86116cc6db (62c615e4-f0c0-48b9-9126-4f86116cc6db): created successfully Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea409eef-d7db-4cb5-9e8d-6a9638fcb773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:22 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (de9e845a-96d6-4a44-a563-c7538578f464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:22 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-20b9e7a7-a37b-4a6f-a8ba-fba4e83e18b9 tempest-ProjectReaderTests-313516393 None] Created volume successfully. Aug 11 06:49:23 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f.b66f533c-f3d2-4251-9ac2-0a595966f033" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-b66f533c-f3d2-4251-9ac2-0a595966f033" released by "_delete_snapshot" :: held 1.930s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" released by "delete_snapshot" :: held 1.955s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Created reservations ['ed193200-ffb0-4353-83b8-74fd646c9635', 'b6cdda14-541e-4248-8208-4ddec1ae9b83', 'a936ad87-38f9-4876-be73-d8c964255bce', '166ec2ec-f3d1-4e59-9a72-34eac4c7e4ec'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:23 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-14ef58e1-2660-4094-a15c-f6c5b49dcb83 tempest-ProjectMemberTests-478824 None] Lock "cinder-b66f533c-f3d2-4251-9ac2-0a595966f033-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-f452230c-ac61-466b-b9ff-cb86917d004f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "cinder-f452230c-ac61-466b-b9ff-cb86917d004f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[889fd820-0bc7-41fb-a6ef-cae14a6b2173]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:23 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f Aug 11 06:49:23 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:24 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f" returned: 0 in 0.532s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Creating offline snapshot 859960ef-79fb-4df6-b09a-57754025e542 of volume 62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:24 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f Aug 11 06:49:24 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4902d5-45bb-40d6-86c8-7bb493c211a0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:24 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db Aug 11 06:49:24 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:24 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f452230c-ac61-466b-b9ff-cb86917d004f" returned: 0 in 0.300s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f452230c-ac61-466b-b9ff-cb86917d004f" released by "delete_volume" :: held 0.913s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Created reservations ['53e88c3f-8969-41b3-89dc-5ed5e29cb56b', '885505cb-1ec5-47a0-b103-9cda94f6a0d2', '75e44cf1-9181-4fa3-8116-aaf53b7d7f11', '0770a2b9-cd7e-49e3-9468-ff9e1441ff38'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:24 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:24 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:24 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db" returned: 0 in 0.523s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:24 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 1G Aug 11 06:49:24 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:24 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.379s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:24 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:25 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-240dbd79-be3f-4cbe-bd9c-dd93dd0f5fb1 tempest-ProjectMemberTests-478824 None] Lock "cinder-f452230c-ac61-466b-b9ff-cb86917d004f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (e11a8ce0-8674-4edd-8ac1-c503d6510520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a00cf2-25b2-48f4-b170-12d9ed4a48ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a00cf2-25b2-48f4-b170-12d9ed4a48ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180815098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44708d5f-b70f-48b1-a94c-aac827e93cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:25Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0320281-589e-4896-8f8e-7207215d6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0320281-589e-4896-8f8e-7207215d6d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20beca07-852a-437a-840b-e136fd88e55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:25 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20beca07-852a-437a-840b-e136fd88e55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44708d5f-b70f-48b1-a94c-aac827e93cb0', 'volume_name': 'volume-44708d5f-b70f-48b1-a94c-aac827e93cb0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43386e93-8ee3-4992-8b35-60ed8e523fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43386e93-8ee3-4992-8b35-60ed8e523fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac2528e-d4a2-489c-9143-4dfd9911b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:25 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Volume 44708d5f-b70f-48b1-a94c-aac827e93cb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44708d5f-b70f-48b1-a94c-aac827e93cb0', 'volume_size': 1} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 1G" returned: 0 in 0.788s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c615e4-f0c0-48b9-9126-4f86116cc6db -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:25 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c615e4-f0c0-48b9-9126-4f86116cc6db -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 Aug 11 06:49:25 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:25 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c615e4-f0c0-48b9-9126-4f86116cc6db -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:25 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 is being set with open permissions: ugo+rw Aug 11 06:49:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:25 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 Aug 11 06:49:25 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:26 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542" returned: 0 in 0.314s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:26 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info Aug 11 06:49:26 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:26 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:26 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info is being set with open permissions: ugo+rw Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:26 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info Aug 11 06:49:26 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:26 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.info" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1180815098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44708d5f-b70f-48b1-a94c-aac827e93cb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:25Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Creating volume 44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:26 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:26 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 1073741824 Aug 11 06:49:26 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:26 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-70e0f93d-8667-4a7a-b9ab-186f54ed6833 tempest-ProjectReaderTests-313516393 None] Create snapshot completed successfully Aug 11 06:49:27 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 1073741824" returned: 0 in 0.620s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:27 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 Aug 11 06:49:27 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-859960ef-79fb-4df6-b09a-57754025e542-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-859960ef-79fb-4df6-b09a-57754025e542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-859960ef-79fb-4df6-b09a-57754025e542" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-859960ef-79fb-4df6-b09a-57754025e542" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Deleting offline snapshot 859960ef-79fb-4df6-b09a-57754025e542 of volume 62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] snapshot_file for this snap is: volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[34713079-cb5c-41a2-8d74-81ca5d6b3c33]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:27 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0" returned: 0 in 0.337s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac2528e-d4a2-489c-9143-4dfd9911b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44708d5f-b70f-48b1-a94c-aac827e93cb0', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5b34e-431c-4818-ba86-2f026f0ece2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:27 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Volume volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 (44708d5f-b70f-48b1-a94c-aac827e93cb0): created successfully Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa5b34e-431c-4818-ba86-2f026f0ece2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:27 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (e11a8ce0-8674-4edd-8ac1-c503d6510520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:27 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-438cde4f-9f0a-4ab5-84f0-010a0836cc5b tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:49:28 devstack sudo[114171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 Aug 11 06:49:28 devstack sudo[114171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:28 devstack sudo[114171]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c615e4-f0c0-48b9-9126-4f86116cc6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15a0e2-0b54-490f-9bab-aa2c09039d51]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:28 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db Aug 11 06:49:28 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:28 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db" returned: 0 in 0.510s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:28 devstack sudo[114183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 Aug 11 06:49:28 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Creating offline snapshot 833eb2b7-d530-4dc2-b734-98916049e542 of volume 44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f0d520-6a59-4cae-9712-3adc839f03e8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:29 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 Aug 11 06:49:29 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:29 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542" returned: 0 in 0.461s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:29 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542 Aug 11 06:49:29 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:29 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0" returned: 0 in 0.443s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:29 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 1G Aug 11 06:49:29 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:29 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db.859960ef-79fb-4df6-b09a-57754025e542" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-859960ef-79fb-4df6-b09a-57754025e542" released by "_delete_snapshot" :: held 1.917s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" released by "delete_snapshot" :: held 1.954s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Created reservations ['7c8044b1-7729-421f-b6eb-cb1c2871c29f', 'e8212f97-563e-48b5-b8ad-a4afb2f0e246', '62a4c9ab-1151-46e1-b46c-f8bc53c157ab', '30cd9c0d-08f6-4ae7-8154-f33162cf908c'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:29 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Delete snapshot completed successfully. Aug 11 06:49:29 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-374d92fd-9619-4f31-ad92-83cd3ee386f1 tempest-ProjectReaderTests-313516393 None] Lock "cinder-859960ef-79fb-4df6-b09a-57754025e542-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:30 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 1G" returned: 0 in 0.698s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:30 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 Aug 11 06:49:30 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:30 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542" returned: 0 in 0.393s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:30 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 is being set with open permissions: ugo+rw Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:30 devstack sudo[114210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 Aug 11 06:49:30 devstack sudo[114210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:30 devstack sudo[114210]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542" returned: 0 in 0.282s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:30 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info Aug 11 06:49:30 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-62c615e4-f0c0-48b9-9126-4f86116cc6db-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "cinder-62c615e4-f0c0-48b9-9126-4f86116cc6db-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:31 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info" returned: 0 in 0.373s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:31 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info is being set with open permissions: ugo+rw Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46dbbba-453e-40e1-b8fc-eb43656b4b60]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:31 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info Aug 11 06:49:31 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:31 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db Aug 11 06:49:31 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:31 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.info" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.683s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:31 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5d28f942-9753-4695-8941-c9872876937c tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:49:31 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db" returned: 0 in 0.512s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:31 devstack sudo[114225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db Aug 11 06:49:31 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:32 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-62c615e4-f0c0-48b9-9126-4f86116cc6db" returned: 0 in 0.265s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-62c615e4-f0c0-48b9-9126-4f86116cc6db" released by "delete_volume" :: held 0.881s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Created reservations ['225459b1-69ed-4508-9703-b0bb2122cb84', '2333a0d2-ab3c-4980-96d4-352aac056477', 'd44e00f7-8d27-4cb6-bf50-54536ab4cad4', '9fdb7f7f-81ac-4248-acce-ae74eeab72d3'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-833eb2b7-d530-4dc2-b734-98916049e542-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-833eb2b7-d530-4dc2-b734-98916049e542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-833eb2b7-d530-4dc2-b734-98916049e542" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:32 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:32 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-833eb2b7-d530-4dc2-b734-98916049e542" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot 833eb2b7-d530-4dc2-b734-98916049e542 of volume 44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b538f220-021f-4207-9e11-61cbfb14046a]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:32 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 Aug 11 06:49:32 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:32 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.287s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Deleted volume successfully. Aug 11 06:49:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-7020acf4-db1b-4bf4-8e45-d30cc7be50a8 tempest-ProjectReaderTests-313516393 None] Lock "cinder-62c615e4-f0c0-48b9-9126-4f86116cc6db-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:32 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542" returned: 0 in 0.584s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44708d5f-b70f-48b1-a94c-aac827e93cb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (bed5e324-d0bd-4c97-b40f-2ea26cd5ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8641cd05-02ef-4a49-8eac-f4cc3d593394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90e7ed-da2e-4929-83f0-781a112d4a8e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8641cd05-02ef-4a49-8eac-f4cc3d593394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681528326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6763b1-56e4-43cb-8ed5-928409e4c11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:33Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcdae94-951f-44e2-a771-58aa38680cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcdae94-951f-44e2-a771-58aa38680cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696cd551-36c2-412f-b662-f7c1592bb4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696cd551-36c2-412f-b662-f7c1592bb4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6763b1-56e4-43cb-8ed5-928409e4c11b', 'volume_name': 'volume-de6763b1-56e4-43cb-8ed5-928409e4c11b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373d17a4-5606-4518-829c-4967f4dfba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373d17a4-5606-4518-829c-4967f4dfba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07936e55-2efc-404d-a196-1e3651fb173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Volume de6763b1-56e4-43cb-8ed5-928409e4c11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6763b1-56e4-43cb-8ed5-928409e4c11b', 'volume_size': 1} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681528326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6763b1-56e4-43cb-8ed5-928409e4c11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:33Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Creating volume de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:33 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:33 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b 1073741824 Aug 11 06:49:33 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:33 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 Aug 11 06:49:33 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:33 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0" returned: 0 in 0.451s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:33 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 Aug 11 06:49:33 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:33 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b 1073741824" returned: 0 in 0.623s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:33 devstack sudo[114257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b Aug 11 06:49:33 devstack sudo[114257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:34 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542" returned: 0 in 0.555s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:34 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542 Aug 11 06:49:34 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:34 devstack sudo[114257]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b" returned: 0 in 0.378s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07936e55-2efc-404d-a196-1e3651fb173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6763b1-56e4-43cb-8ed5-928409e4c11b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7068c322-c3f6-4d50-adae-4b1f15d4fb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:34 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Volume volume-de6763b1-56e4-43cb-8ed5-928409e4c11b (de6763b1-56e4-43cb-8ed5-928409e4c11b): created successfully Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7068c322-c3f6-4d50-adae-4b1f15d4fb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (bed5e324-d0bd-4c97-b40f-2ea26cd5ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4374e399-dcd5-47bd-b4de-949ffa806d7f tempest-ProjectReaderTests-313516393 None] Created volume successfully. Aug 11 06:49:34 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0.833eb2b7-d530-4dc2-b734-98916049e542" returned: 0 in 0.352s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-833eb2b7-d530-4dc2-b734-98916049e542" released by "_delete_snapshot" :: held 2.109s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" released by "delete_snapshot" :: held 2.202s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Created reservations ['c90b5da9-fa96-4423-bd5e-7a6b5dc03725', '50d73b25-b180-481c-8397-c5ae8152fc9b', '64ceec1d-7ec1-4923-b23e-7a8ea38438ea', 'ab7a3898-ca08-4c78-84e9-3fb275d8abc6'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:34 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:49:34 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-c17baa5d-31f7-4cc8-b257-b138d76f9263 tempest-ProjectMemberTests-478824 None] Lock "cinder-833eb2b7-d530-4dc2-b734-98916049e542-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Creating offline snapshot a13064ff-deec-41b3-aaf8-24e0f7b40d89 of volume de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b60356-c5d3-4a6e-bc9d-8675276e912b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-44708d5f-b70f-48b1-a94c-aac827e93cb0-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "cinder-44708d5f-b70f-48b1-a94c-aac827e93cb0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:35 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b Aug 11 06:49:35 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7af60a7-0b8d-4bcf-a6fe-d68adf6f7abf]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:35 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 Aug 11 06:49:35 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:35 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b" returned: 0 in 0.562s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:36 devstack sudo[114271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 1G Aug 11 06:49:36 devstack sudo[114271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:36 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0" returned: 0 in 0.560s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:36 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0 Aug 11 06:49:36 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:36 devstack sudo[114271]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 1G" returned: 0 in 0.708s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6763b1-56e4-43cb-8ed5-928409e4c11b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:36 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6763b1-56e4-43cb-8ed5-928409e4c11b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 Aug 11 06:49:36 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:36 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-44708d5f-b70f-48b1-a94c-aac827e93cb0" returned: 0 in 0.496s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-44708d5f-b70f-48b1-a94c-aac827e93cb0" released by "delete_volume" :: held 1.159s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Created reservations ['35218ab6-2098-4254-b769-4b07984f7767', 'aae6fc13-6f7b-4f9b-88c8-4b33eb37c67c', 'abf4ce8e-103b-4cfc-9f0e-257f7294a4a1', 'e2dbbf59-97df-44fe-949c-5729b121b541'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:36 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:36 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:37 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6763b1-56e4-43cb-8ed5-928409e4c11b -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 is being set with open permissions: ugo+rw Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:37 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 Aug 11 06:49:37 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:37 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:37 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-674e4ed1-5afb-4f49-b0d1-0e9f863f42fc tempest-ProjectMemberTests-478824 None] Lock "cinder-44708d5f-b70f-48b1-a94c-aac827e93cb0-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:37 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89" returned: 0 in 0.283s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:37 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info Aug 11 06:49:37 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:37 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info is being set with open permissions: ugo+rw Aug 11 06:49:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:37 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info Aug 11 06:49:37 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:38 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.info" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-d5dd7dff-dac7-466b-8977-8d0ddb9ffb96 tempest-ProjectReaderTests-313516393 None] Create snapshot completed successfully Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (7a4476a3-f2d9-41c5-b169-250ab1fcb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102e0de0-cf32-456a-aa34-962eb704637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (102e0de0-cf32-456a-aa34-962eb704637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389032389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379c72e3-d4bb-459b-a0f2-ff1fc449aa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:38Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6f6a3c-8d3f-4026-90a4-41b40d461c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6f6a3c-8d3f-4026-90a4-41b40d461c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be502b8-45ef-4ee3-9b22-09e21e3dda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be502b8-45ef-4ee3-9b22-09e21e3dda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379c72e3-d4bb-459b-a0f2-ff1fc449aa4f', 'volume_name': 'volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018761f7-a06c-44fc-b71c-0c53f33ab7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018761f7-a06c-44fc-b71c-0c53f33ab7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50b8c5-ea5f-48eb-9ecc-d60de8524a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:38 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Volume 379c72e3-d4bb-459b-a0f2-ff1fc449aa4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f', 'volume_size': 1} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389032389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379c72e3-d4bb-459b-a0f2-ff1fc449aa4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:38Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Creating volume 379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:38 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:38 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f 1073741824 Aug 11 06:49:38 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-a13064ff-deec-41b3-aaf8-24e0f7b40d89-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-a13064ff-deec-41b3-aaf8-24e0f7b40d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-a13064ff-deec-41b3-aaf8-24e0f7b40d89" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a13064ff-deec-41b3-aaf8-24e0f7b40d89" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Deleting offline snapshot a13064ff-deec-41b3-aaf8-24e0f7b40d89 of volume de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] snapshot_file for this snap is: volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b859f-7cec-4572-9bc6-844663796919]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:38 devstack sudo[114304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 Aug 11 06:49:38 devstack sudo[114304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:39 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f 1073741824" returned: 0 in 0.626s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:39 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f Aug 11 06:49:39 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:39 devstack sudo[114304]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de6763b1-56e4-43cb-8ed5-928409e4c11b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f478dff-8568-4552-87a2-2ae96dc8c718]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:39 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b Aug 11 06:49:39 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:39 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" returned: 0 in 0.375s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50b8c5-ea5f-48eb-9ecc-d60de8524a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceab307e-c7e2-4196-9f75-81c34473a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:39 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Volume volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f (379c72e3-d4bb-459b-a0f2-ff1fc449aa4f): created successfully Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceab307e-c7e2-4196-9f75-81c34473a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (7a4476a3-f2d9-41c5-b169-250ab1fcb39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:39 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-12578990-883e-472c-a8fd-79d3b17a7e8f tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:49:39 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:39 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 Aug 11 06:49:39 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:40 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:40 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89 Aug 11 06:49:40 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:40 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b.a13064ff-deec-41b3-aaf8-24e0f7b40d89" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a13064ff-deec-41b3-aaf8-24e0f7b40d89" released by "_delete_snapshot" :: held 1.949s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" released by "delete_snapshot" :: held 1.987s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Created reservations ['6e8f7965-8626-408e-baaa-f470c2fe6f77', '76c2150a-7c8b-4ef6-9264-54e2399b7233', '79123a70-b9d4-4eff-bed8-fad735b27873', '0859020d-e255-4fe6-ba8e-3e13db558717'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:40 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Delete snapshot completed successfully. Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Creating offline snapshot 2432d9df-f16a-45de-983c-0003c19c008d of volume 379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-1608e0de-f0b8-43cc-9144-f29caa03b220 tempest-ProjectReaderTests-313516393 None] Lock "cinder-a13064ff-deec-41b3-aaf8-24e0f7b40d89-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee789ab4-b20d-401b-a1eb-8fcf99f63f62]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:41 devstack sudo[114330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f Aug 11 06:49:41 devstack sudo[114330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:41 devstack sudo[114330]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" returned: 0 in 0.441s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:41 devstack sudo[114335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d 1G Aug 11 06:49:41 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:41 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:41 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-de6763b1-56e4-43cb-8ed5-928409e4c11b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d 1G" returned: 0 in 0.581s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "cinder-de6763b1-56e4-43cb-8ed5-928409e4c11b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:42 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d Aug 11 06:49:42 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df938c0-d41d-4f60-89f0-363cd771222e]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:42 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b Aug 11 06:49:42 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:42 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:42 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d is being set with open permissions: ugo+rw Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:42 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d Aug 11 06:49:42 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:42 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b" returned: 0 in 0.470s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:42 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b Aug 11 06:49:42 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:42 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d" returned: 0 in 0.339s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:42 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info Aug 11 06:49:42 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:42 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-de6763b1-56e4-43cb-8ed5-928409e4c11b" returned: 0 in 0.308s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-de6763b1-56e4-43cb-8ed5-928409e4c11b" released by "delete_volume" :: held 0.870s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Created reservations ['908ee807-d0e3-4062-89fc-9b759b045b9d', '6998c7b5-6e8c-4227-bc61-a91e6b975e6b', '36746ebd-7ede-4357-8285-86a619ed718d', '4c67e1bb-2c9f-4a5a-a7d5-719881ac633f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:43 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info" returned: 0 in 0.419s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:43 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info is being set with open permissions: ugo+rw Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:43 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:43 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:43 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info Aug 11 06:49:43 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:43 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.465s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Deleted volume successfully. Aug 11 06:49:43 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.info" returned: 0 in 0.477s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2aee5de9-36ae-4236-8bc6-07e26c2ea0d5 tempest-ProjectReaderTests-313516393 None] Lock "cinder-de6763b1-56e4-43cb-8ed5-928409e4c11b-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:43 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6a4a7e49-a34b-4170-a74d-9440d605fa59 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-2432d9df-f16a-45de-983c-0003c19c008d-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-2432d9df-f16a-45de-983c-0003c19c008d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (c42ae62a-e1bb-457c-9b5b-76908b8cd0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a9e011-a881-4a2a-baa0-5451355a1e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" acquired by "delete_snapshot" :: waited 0.059s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-2432d9df-f16a-45de-983c-0003c19c008d" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a9e011-a881-4a2a-baa0-5451355a1e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176071648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21d44c5-0fb3-4e40-a693-46880cde26f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:44Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14236478-f07f-4079-b26a-6aa2598dae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14236478-f07f-4079-b26a-6aa2598dae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe7d6e-bc23-44af-8b49-5f99c0b0d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfe7d6e-bc23-44af-8b49-5f99c0b0d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21d44c5-0fb3-4e40-a693-46880cde26f5', 'volume_name': 'volume-a21d44c5-0fb3-4e40-a693-46880cde26f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99db1d-bdfc-47be-996c-d2e9f671b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99db1d-bdfc-47be-996c-d2e9f671b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1099ba00-3d59-46a1-9e29-2e3f9f8ca751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:44 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Volume a21d44c5-0fb3-4e40-a693-46880cde26f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21d44c5-0fb3-4e40-a693-46880cde26f5', 'volume_size': 1} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-176071648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21d44c5-0fb3-4e40-a693-46880cde26f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:44Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Creating volume a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:44 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-2432d9df-f16a-45de-983c-0003c19c008d" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:44 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 1073741824 Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot 2432d9df-f16a-45de-983c-0003c19c008d of volume 379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:44 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f0e8f-5034-48c6-b31b-4a61e0082477]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:44 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d Aug 11 06:49:44 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:44 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d" returned: 0 in 0.406s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:44 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 1073741824" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae4448-71fe-40dc-8097-20a586c22e15]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:44 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 Aug 11 06:49:44 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:44 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f Aug 11 06:49:44 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:45 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5" returned: 0 in 0.340s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1099ba00-3d59-46a1-9e29-2e3f9f8ca751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21d44c5-0fb3-4e40-a693-46880cde26f5', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33346ff7-ef67-4d65-b5a3-175fc5139e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Volume volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 (a21d44c5-0fb3-4e40-a693-46880cde26f5): created successfully Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33346ff7-ef67-4d65-b5a3-175fc5139e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (c42ae62a-e1bb-457c-9b5b-76908b8cd0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:45 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-65b954a0-707f-44e4-a28d-1f8e77a9e26b tempest-ProjectReaderTests-313516393 None] Created volume successfully. Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:45 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (ffc68fab-6879-4f19-82c6-cdc37d4a573b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0243ee36-faad-4837-a234-6ba0773f830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" returned: 0 in 0.545s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0243ee36-faad-4837-a234-6ba0773f830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193499717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508b715d-ee81-46f7-b404-95e60d40c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:45Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed41d569-5603-47c4-ab83-f230f4acd0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack sudo[114386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d Aug 11 06:49:45 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed41d569-5603-47c4-ab83-f230f4acd0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573d723-7f93-426c-ae94-e35d260ff41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573d723-7f93-426c-ae94-e35d260ff41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508b715d-ee81-46f7-b404-95e60d40c3f7', 'volume_name': 'volume-508b715d-ee81-46f7-b404-95e60d40c3f7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e22f26-fd8e-4453-b8c6-9880b0e6d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e22f26-fd8e-4453-b8c6-9880b0e6d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bbdffa-d208-41ed-b2b9-d318df36d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:45 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Volume 508b715d-ee81-46f7-b404-95e60d40c3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508b715d-ee81-46f7-b404-95e60d40c3f7', 'volume_size': 1} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193499717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508b715d-ee81-46f7-b404-95e60d40c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:45Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Creating volume 508b715d-ee81-46f7-b404-95e60d40c3f7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:45 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:45 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 1073741824 Aug 11 06:49:45 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:45 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d" returned: 0 in 0.358s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:45 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d Aug 11 06:49:45 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:46 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f.2432d9df-f16a-45de-983c-0003c19c008d" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:46 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 1073741824" returned: 0 in 0.658s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-2432d9df-f16a-45de-983c-0003c19c008d" released by "_delete_snapshot" :: held 1.793s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" released by "delete_snapshot" :: held 1.903s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:46 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 Aug 11 06:49:46 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Created reservations ['1232edef-d552-4a75-bedd-ae9bd54f2637', 'fc449d39-0efe-4104-888f-cf6af730f85e', '464689ea-4797-4e6a-adb4-65838addba7b', '70a40344-5831-4ca1-a98b-ea582e780326'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-44cace0a-6d90-41f0-9345-77f6ca4ed200 tempest-ProjectMemberTests-478824 None] Lock "cinder-2432d9df-f16a-45de-983c-0003c19c008d-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:46 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7" returned: 0 in 0.340s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.038s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bbdffa-d208-41ed-b2b9-d318df36d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508b715d-ee81-46f7-b404-95e60d40c3f7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a45fb97-5820-4b20-ae8b-e167b2c18753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Creating offline snapshot 2aa34212-1018-4c72-8d3d-d672df15a27a of volume a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:46 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Volume volume-508b715d-ee81-46f7-b404-95e60d40c3f7 (508b715d-ee81-46f7-b404-95e60d40c3f7): created successfully Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a45fb97-5820-4b20-ae8b-e167b2c18753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (ffc68fab-6879-4f19-82c6-cdc37d4a573b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c65a6d9-8330-48e8-9d34-59bbf486b820]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-e179a563-3189-43f7-8e7c-13744718737e tempest-ProjectReaderTests-202926630 None] Created volume successfully. Aug 11 06:49:46 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 Aug 11 06:49:46 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:46 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5" returned: 0 in 0.374s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:46 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a 1G Aug 11 06:49:46 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "cinder-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:47 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a 1G" returned: 0 in 0.482s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:47 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a Aug 11 06:49:47 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" acquired by "delete_volume" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b87e819-0058-4e2c-a8df-0aaba614ab5c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-508b715d-ee81-46f7-b404-95e60d40c3f7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "cinder-508b715d-ee81-46f7-b404-95e60d40c3f7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:47 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f Aug 11 06:49:47 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-quobyte-508b715d-ee81-46f7-b404-95e60d40c3f7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-508b715d-ee81-46f7-b404-95e60d40c3f7" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dee03a-707a-4129-9cc3-fc084f4e4fed]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:47 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a" returned: 0 in 0.449s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:47 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a is being set with open permissions: ugo+rw Aug 11 06:49:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:47 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a Aug 11 06:49:47 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:47 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 Aug 11 06:49:47 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" returned: 0 in 0.504s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f Aug 11 06:49:48 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info Aug 11 06:49:48 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7" returned: 0 in 0.477s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7 Aug 11 06:49:48 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" returned: 0 in 0.297s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f" released by "delete_volume" :: held 0.898s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Created reservations ['60211c23-6282-4284-a9a8-896cceebed2e', 'f7429e64-25c6-4cfb-8df6-66c6c45768ec', '886a3048-532d-4737-ae55-3a031a538e2c', '6a30b257-1813-4de1-a065-d676673bf33a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:48 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info" returned: 0 in 0.388s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info is being set with open permissions: ugo+rw Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-508b715d-ee81-46f7-b404-95e60d40c3f7" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:48 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info Aug 11 06:49:48 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-508b715d-ee81-46f7-b404-95e60d40c3f7" released by "delete_volume" :: held 0.891s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Created reservations ['7058d0da-ff78-4ac1-88a7-2f2e56766e48', '159e793b-91fe-45c4-a9ee-329a5b798fa3', '1b37f020-a2b0-422b-bd16-adec7d94afd2', '6934e71e-5023-4691-bc74-7dcf17759280'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:48 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:48 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:48 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.412s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-72123e89-b36f-4b9e-8bd2-77a404f9d500 tempest-ProjectMemberTests-478824 None] Lock "cinder-379c72e3-d4bb-459b-a0f2-ff1fc449aa4f-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:49 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.info" returned: 0 in 0.572s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a02ce573-a204-41ae-8de2-875eebb60085 tempest-ProjectReaderTests-313516393 None] Create snapshot completed successfully Aug 11 06:49:49 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.400s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Deleted volume successfully. Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-00997b76-a32d-4006-90a5-e7e1c7ca4a23 tempest-ProjectReaderTests-202926630 None] Lock "cinder-508b715d-ee81-46f7-b404-95e60d40c3f7-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (a5d908fd-a635-41dd-87c2-4c36509a3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de1dae0-f729-4628-a064-e3f3223b20c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de1dae0-f729-4628-a064-e3f3223b20c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303821712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca3fb92-941e-494a-8eff-0c0e8e0a9e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:49Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90f31dc-2b41-422d-b03b-2c4e81c08ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90f31dc-2b41-422d-b03b-2c4e81c08ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57c2a6b-5822-46da-8df7-a955d0a6dd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57c2a6b-5822-46da-8df7-a955d0a6dd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca3fb92-941e-494a-8eff-0c0e8e0a9e77', 'volume_name': 'volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc79b38-2953-4834-9caf-4ef794ce27d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc79b38-2953-4834-9caf-4ef794ce27d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f585bb-9be7-46b4-9ee5-80590c2a10f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:49 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Volume 9ca3fb92-941e-494a-8eff-0c0e8e0a9e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77', 'volume_size': 1} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303821712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca3fb92-941e-494a-8eff-0c0e8e0a9e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:49Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Creating volume 9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:49 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:49 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 1073741824 Aug 11 06:49:49 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-2aa34212-1018-4c72-8d3d-d672df15a27a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-2aa34212-1018-4c72-8d3d-d672df15a27a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-2aa34212-1018-4c72-8d3d-d672df15a27a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-2aa34212-1018-4c72-8d3d-d672df15a27a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Deleting offline snapshot 2aa34212-1018-4c72-8d3d-d672df15a27a of volume a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] snapshot_file for this snap is: volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d0a111-1d16-4d0b-ba05-1f28ae52c60c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:50 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a Aug 11 06:49:50 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:50 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 1073741824" returned: 0 in 0.644s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:50 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 Aug 11 06:49:50 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:50 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a" returned: 0 in 0.577s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a21d44c5-0fb3-4e40-a693-46880cde26f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebbdc0-f295-4465-8216-b056b636682d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:50 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f585bb-9be7-46b4-9ee5-80590c2a10f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 Aug 11 06:49:50 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7cdb0-2775-4ecb-b26b-d5b16ff997ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (a3108e19-cc97-458b-89f1-3136f066b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5e14b0-4017-4551-bafe-24996c5ae2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Volume volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 (9ca3fb92-941e-494a-8eff-0c0e8e0a9e77): created successfully Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb7cdb0-2775-4ecb-b26b-d5b16ff997ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (a5d908fd-a635-41dd-87c2-4c36509a3afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5e14b0-4017-4551-bafe-24996c5ae2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183528616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00991962-1267-4b1e-a549-de58c79b32a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:51Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a07fc-538f-48e8-bf6c-79834d17b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2a07fc-538f-48e8-bf6c-79834d17b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eda6b1e-2d2e-4007-bb6e-622b0770330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eda6b1e-2d2e-4007-bb6e-622b0770330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00991962-1267-4b1e-a549-de58c79b32a7', 'volume_name': 'volume-00991962-1267-4b1e-a549-de58c79b32a7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da346365-3874-47f4-8c56-9e5b63fdcb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da346365-3874-47f4-8c56-9e5b63fdcb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d5f5e6-057b-49bc-a5e4-374a4cd98063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:50 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Volume 00991962-1267-4b1e-a549-de58c79b32a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00991962-1267-4b1e-a549-de58c79b32a7', 'volume_size': 1} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183528616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00991962-1267-4b1e-a549-de58c79b32a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:51Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Creating volume 00991962-1267-4b1e-a549-de58c79b32a7 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:50 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:50 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:50 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f68605d0-cea3-44f8-9108-75db0a256447 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:49:50 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 1073741824 Aug 11 06:49:50 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:51 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5" returned: 0 in 0.543s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:51 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a Aug 11 06:49:51 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:51 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 1073741824" returned: 0 in 0.574s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:51 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 Aug 11 06:49:51 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:51 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a" returned: 0 in 0.518s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:51 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a Aug 11 06:49:51 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:51 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7" returned: 0 in 0.353s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d5f5e6-057b-49bc-a5e4-374a4cd98063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00991962-1267-4b1e-a549-de58c79b32a7', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0538790-8879-428c-bdd0-28b44dd723b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:51 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Volume volume-00991962-1267-4b1e-a549-de58c79b32a7 (00991962-1267-4b1e-a549-de58c79b32a7): created successfully Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0538790-8879-428c-bdd0-28b44dd723b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:51 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (a3108e19-cc97-458b-89f1-3136f066b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6aead32c-3a3a-4d08-a88d-a47f22002990 tempest-ProjectReaderTests-202926630 None] Created volume successfully. Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:52 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5.2aa34212-1018-4c72-8d3d-d672df15a27a" returned: 0 in 0.394s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Creating offline snapshot bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb of volume 9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-2aa34212-1018-4c72-8d3d-d672df15a27a" released by "_delete_snapshot" :: held 2.231s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" released by "delete_snapshot" :: held 2.263s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9873370e-25ea-46d1-8bef-d0062c02b789]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Created reservations ['78f7f561-e6cd-42f9-a6fe-5cb0e0be3759', '331c2012-82e7-4cab-b416-27e63a2659c9', '42aa9e85-9425-4ec2-9b5b-081428bfbf6a', '48f0e8ae-24a2-424e-ac87-f24f0f2ae582'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:52 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 Aug 11 06:49:52 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:52 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Delete snapshot completed successfully. Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-31ef386e-6d1a-42fa-9b18-7629d308bf7c tempest-ProjectReaderTests-313516393 None] Lock "cinder-2aa34212-1018-4c72-8d3d-d672df15a27a-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:52 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" returned: 0 in 0.447s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:52 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb 1G Aug 11 06:49:52 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-00991962-1267-4b1e-a549-de58c79b32a7-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:52 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "cinder-00991962-1267-4b1e-a549-de58c79b32a7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-quobyte-00991962-1267-4b1e-a549-de58c79b32a7" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-00991962-1267-4b1e-a549-de58c79b32a7" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7e1870-16ba-4741-9873-88e5950478f8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Flow 'volume_create_manager' (7e7aa914-db30-4a78-81f0-ca4d4291651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f21c91-09cf-4b6f-978a-beff25b3166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-a21d44c5-0fb3-4e40-a693-46880cde26f5-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f21c91-09cf-4b6f-978a-beff25b3166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130420351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac899f7d-612a-48ff-9e76-1e95d1e7293c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555c0bc82c814b25bdfb4bcb8583a965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:53Z,use_quota=True,user_id='f1457708ec9e43c69faa0d89633bbb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:53 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde0b7f-5c6f-433b-9117-bba4b19f01f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde0b7f-5c6f-433b-9117-bba4b19f01f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83453d4b-4ca3-4483-934d-2ebc95bf869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83453d4b-4ca3-4483-934d-2ebc95bf869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac899f7d-612a-48ff-9e76-1e95d1e7293c', 'volume_name': 'volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:53 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 Aug 11 06:49:53 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43946bd4-dad4-4529-b4de-19e8b0dbadbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43946bd4-dad4-4529-b4de-19e8b0dbadbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15469eb-6d68-4b69-b805-a63197d3a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:53 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Volume ac899f7d-612a-48ff-9e76-1e95d1e7293c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c', 'volume_size': 1} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb 1G" returned: 0 in 0.703s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "cinder-a21d44c5-0fb3-4e40-a693-46880cde26f5-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:53 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb Aug 11 06:49:53 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" acquired by "delete_volume" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc7932-daa3-4e2a-aba5-e4dcc3c0a609]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7" returned: 0 in 0.438s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack sudo[114504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 Aug 11 06:49:53 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7 Aug 11 06:49:53 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" returned: 0 in 0.332s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb is being set with open permissions: ugo+rw Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb Aug 11 06:49:53 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-00991962-1267-4b1e-a549-de58c79b32a7" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-00991962-1267-4b1e-a549-de58c79b32a7" released by "delete_volume" :: held 0.766s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5" returned: 0 in 0.416s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5 Aug 11 06:49:53 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:53 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Created reservations ['6bc602d2-fd06-4357-9b36-530f4af10f15', '3e4882ac-43ad-4e3d-a944-dd951c4696af', '69a8ae72-7ab8-4396-944c-d848f26ad3c8', 'cb12fbc4-a95d-45e7-b363-6e6e7005ecb7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:53 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:53 devstack sudo[114523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info Aug 11 06:49:53 devstack sudo[114523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:54 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:54 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:54 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-a21d44c5-0fb3-4e40-a693-46880cde26f5" returned: 0 in 0.300s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-a21d44c5-0fb3-4e40-a693-46880cde26f5" released by "delete_volume" :: held 0.805s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Created reservations ['4a9c0e27-97ce-471f-8aa4-63becb00095e', '7fed7c3e-7ea2-45c6-902f-1152c07ce81d', '73fbb9b8-c158-4cc7-a6b1-434076f72008', '1a20972b-f9bc-484d-9a10-07ccd572badc'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:54 devstack sudo[114523]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info" returned: 0 in 0.318s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:54 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info is being set with open permissions: ugo+rw Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:54 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info Aug 11 06:49:54 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:54 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.304s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Deleted volume successfully. Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-46f8041b-67be-4548-b305-d9abc20d06d1 tempest-ProjectReaderTests-202926630 None] Lock "cinder-00991962-1267-4b1e-a549-de58c79b32a7-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:54 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:54 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:54 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.info" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.580s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130420351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac899f7d-612a-48ff-9e76-1e95d1e7293c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555c0bc82c814b25bdfb4bcb8583a965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:53Z,use_quota=True,user_id='f1457708ec9e43c69faa0d89633bbb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Creating volume ac899f7d-612a-48ff-9e76-1e95d1e7293c {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:54 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:54 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c 1073741824 Aug 11 06:49:54 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-22c06477-0230-4fc2-bdc6-f8052df054d4 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:49:54 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.374s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:54 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Deleted volume successfully. Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-4f103269-c32b-490e-893d-6b029a6f4b27 tempest-ProjectReaderTests-313516393 None] Lock "cinder-a21d44c5-0fb3-4e40-a693-46880cde26f5-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (e85dcd08-3edf-4f02-89dc-5d7f0afca751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7be7e0-8554-4db9-af10-4c894962e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7be7e0-8554-4db9-af10-4c894962e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447065445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3471bc60-d946-4bb8-bfcb-82646532745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:55Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2f249-6fbf-4b84-9d80-692bcc7ef4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2f249-6fbf-4b84-9d80-692bcc7ef4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433500f4-f204-42f2-9e4d-28be33fb7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433500f4-f204-42f2-9e4d-28be33fb7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3471bc60-d946-4bb8-bfcb-82646532745b', 'volume_name': 'volume-3471bc60-d946-4bb8-bfcb-82646532745b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4387a3-b0fb-47bc-8fc5-d9bd8de1a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4387a3-b0fb-47bc-8fc5-d9bd8de1a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b43a28b-4f31-4e6a-adde-9f5d82d1db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:54 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Volume 3471bc60-d946-4bb8-bfcb-82646532745b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3471bc60-d946-4bb8-bfcb-82646532745b', 'volume_size': 1} Aug 11 06:49:54 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (32029fa5-a600-418b-b022-8c33bb53839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2389e5e2-7840-4d80-92e6-b8f2963b19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2389e5e2-7840-4d80-92e6-b8f2963b19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383281506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e588a018-819d-4803-9ec1-91998e803b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:55Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8072e28-ae3e-4f54-9c1e-46f42e2b83e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8072e28-ae3e-4f54-9c1e-46f42e2b83e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1924a6-6653-438d-b512-127a525943db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1924a6-6653-438d-b512-127a525943db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e588a018-819d-4803-9ec1-91998e803b54', 'volume_name': 'volume-e588a018-819d-4803-9ec1-91998e803b54', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49be03b-ce39-4f8b-80e3-7f3fdc5adeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49be03b-ce39-4f8b-80e3-7f3fdc5adeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a0e19a-0b24-4837-91db-63e63d228f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Volume e588a018-819d-4803-9ec1-91998e803b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e588a018-819d-4803-9ec1-91998e803b54', 'volume_size': 1} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:55 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c 1073741824" returned: 0 in 0.616s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:55 devstack sudo[114541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c Aug 11 06:49:55 devstack sudo[114541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb of volume 9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6f090-3755-4bdf-9137-55cf9a586936]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:55 devstack sudo[114543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb Aug 11 06:49:55 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:55 devstack sudo[114541]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447065445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3471bc60-d946-4bb8-bfcb-82646532745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:55Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Creating volume 3471bc60-d946-4bb8-bfcb-82646532745b {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:55 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15469eb-6d68-4b69-b805-a63197d3a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df941120-0743-4017-a188-cb9ebc7eb18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:55 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b 1073741824 Aug 11 06:49:55 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:55 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Volume volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c (ac899f7d-612a-48ff-9e76-1e95d1e7293c): created successfully Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df941120-0743-4017-a188-cb9ebc7eb18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Flow 'volume_create_manager' (7e7aa914-db30-4a78-81f0-ca4d4291651a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:55 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bfb6bd97-74e5-421d-a74e-7d8bd0dea2e4 tempest-ProjectReaderTests-89268778 None] Created volume successfully. Aug 11 06:49:55 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" returned: 0 in 0.391s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e9cf82-ddf2-4bd6-8046-fa24f576aee2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:55 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:55 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 Aug 11 06:49:55 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b 1073741824" returned: 0 in 0.517s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:56 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b Aug 11 06:49:56 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" returned: 0 in 0.461s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:56 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb Aug 11 06:49:56 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Acquiring lock "cinder-ac899f7d-612a-48ff-9e76-1e95d1e7293c-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "cinder-ac899f7d-612a-48ff-9e76-1e95d1e7293c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:56 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b" returned: 0 in 0.371s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383281506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e588a018-819d-4803-9ec1-91998e803b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:55Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Creating volume e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:49:56 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Acquiring lock "cinder-quobyte-ac899f7d-612a-48ff-9e76-1e95d1e7293c" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b43a28b-4f31-4e6a-adde-9f5d82d1db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3471bc60-d946-4bb8-bfcb-82646532745b', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:56 devstack sudo[114568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 1073741824 Aug 11 06:49:56 devstack sudo[114568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebe4b40-e33a-45c6-aa01-ef6561cc34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:56 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Volume volume-3471bc60-d946-4bb8-bfcb-82646532745b (3471bc60-d946-4bb8-bfcb-82646532745b): created successfully Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebe4b40-e33a-45c6-aa01-ef6561cc34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (e85dcd08-3edf-4f02-89dc-5d7f0afca751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "cinder-quobyte-ac899f7d-612a-48ff-9e76-1e95d1e7293c" acquired by "delete_volume" :: waited 0.059s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07abfcc-28f8-489b-96b3-81a3918312c5]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:56 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ba9b2c76-6220-41e3-b784-8ee38a31daaa tempest-ProjectReaderTests-202926630 None] Created volume successfully. Aug 11 06:49:56 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" returned: 0 in 0.398s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:56 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:56 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb Aug 11 06:49:56 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack sudo[114570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c Aug 11 06:49:56 devstack sudo[114570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:56 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-3471bc60-d946-4bb8-bfcb-82646532745b-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77.bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "cinder-3471bc60-d946-4bb8-bfcb-82646532745b-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb" released by "_delete_snapshot" :: held 1.753s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" released by "delete_snapshot" :: held 1.800s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:57 devstack sudo[114570]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c" returned: 0 in 0.503s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c Aug 11 06:49:57 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-quobyte-3471bc60-d946-4bb8-bfcb-82646532745b" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-3471bc60-d946-4bb8-bfcb-82646532745b" acquired by "delete_volume" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a90db-9bc6-4539-b604-8bebc1e61b36]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack sudo[114568]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 1073741824" returned: 0 in 0.735s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Created reservations ['26fb2b70-4ad4-49e8-b11f-d5ddf6c300a4', '8d6b31c6-eea6-42ed-8b35-c1b3abe13280', '89f65717-8dcb-420f-8733-2d24a23f0a97', 'a08124b9-1343-490a-947b-21f04e766f3e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 Aug 11 06:49:57 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b Aug 11 06:49:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:49:57 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a526718c-8ffb-4d22-9b52-0c01f826ffc0 tempest-ProjectMemberTests-478824 None] Lock "cinder-bdc6aeed-fc9c-4e80-ad9e-10a5ad7323bb-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:57 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ac899f7d-612a-48ff-9e76-1e95d1e7293c" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "cinder-quobyte-ac899f7d-612a-48ff-9e76-1e95d1e7293c" released by "delete_volume" :: held 0.947s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "cinder-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" acquired by "delete_volume" :: waited 0.043s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Created reservations ['4f175853-3197-4e92-9e83-7010769d7ab3', 'f7723565-8b7d-41a1-b32a-f5b4cde9da1c', 'e0035c85-6346-46a5-993d-34a51a647fde', 'f339ffa8-23f3-4678-ad1b-5c4e12fb4f7a'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:57 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b" returned: 0 in 0.521s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ee9a5-cdbc-4699-844d-efa246f23e4f]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b Aug 11 06:49:57 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54" returned: 0 in 0.524s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a0e19a-0b24-4837-91db-63e63d228f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e588a018-819d-4803-9ec1-91998e803b54', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec13bc1-3519-4648-bf10-30a72726c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:57 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:57 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 Aug 11 06:49:57 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:57 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Volume volume-e588a018-819d-4803-9ec1-91998e803b54 (e588a018-819d-4803-9ec1-91998e803b54): created successfully Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec13bc1-3519-4648-bf10-30a72726c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:57 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (32029fa5-a600-418b-b022-8c33bb53839e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:57 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-70784564-9979-472d-830a-164d8f286533 tempest-ProjectReaderTests-313516393 None] Created volume successfully. Aug 11 06:49:58 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-3471bc60-d946-4bb8-bfcb-82646532745b" returned: 0 in 0.342s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-3471bc60-d946-4bb8-bfcb-82646532745b" released by "delete_volume" :: held 0.939s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:58 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.296s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Deleted volume successfully. Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Created reservations ['64e99bc0-6121-457a-8b3c-0833c4b9cdce', 'd8e8e91e-e3f0-49df-8036-7fcfe05dc57a', '21bab8c3-43bd-4b14-8f4d-a12d17d23249', 'f233f4e6-94f4-4756-b417-54e7afff28b4'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-69d9bf17-3b82-4f46-915c-97db48006fca tempest-ProjectReaderTests-89268778 None] Lock "cinder-ac899f7d-612a-48ff-9e76-1e95d1e7293c-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:58 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" returned: 0 in 0.505s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:58 devstack sudo[114605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77 Aug 11 06:49:58 devstack sudo[114605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:58 devstack sudo[114607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:58 devstack sudo[114607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Creating offline snapshot f223d0af-d442-4a82-abaa-f7f0b466c82a of volume e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0b759-6279-4e4b-afa1-d7aee8c634d7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:58 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 Aug 11 06:49:58 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:58 devstack sudo[114605]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" returned: 0 in 0.340s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack sudo[114607]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.307s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77" released by "delete_volume" :: held 0.952s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:58 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Deleted volume successfully. Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8d6ec132-cb40-4fe9-b36e-d8c3462ed82e tempest-ProjectReaderTests-202926630 None] Lock "cinder-3471bc60-d946-4bb8-bfcb-82646532745b-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Created reservations ['afffbd46-26fb-433b-8118-1dba2ee3a9a1', 'c673c6f4-cc2b-4f35-a5f2-aa0b93bd7736', 'a76344ce-4847-44a8-a3c8-3548d4a3fbd4', '373e49aa-d341-4bf8-91c3-caaca356fff8'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:58 devstack sudo[114613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:49:58 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:58 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54" returned: 0 in 0.444s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:58 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:58 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a 1G Aug 11 06:49:58 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:59 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.317s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:49:59 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f208dc3a-fe1d-44b6-9821-6ab36e0ebb41 tempest-ProjectMemberTests-478824 None] Lock "cinder-9ca3fb92-941e-494a-8eff-0c0e8e0a9e77-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Flow 'volume_create_manager' (e4f85dbe-558d-4206-8bfd-64cba0759fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc3adf0-8ef2-47d2-bc9b-0a04b5a107f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc3adf0-8ef2-47d2-bc9b-0a04b5a107f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442018474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f51c14-9414-4b84-b27b-4ec2b44768a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555c0bc82c814b25bdfb4bcb8583a965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:59Z,use_quota=True,user_id='f1457708ec9e43c69faa0d89633bbb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6469ec9b-b215-493e-8790-fa0cc6f017a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6469ec9b-b215-493e-8790-fa0cc6f017a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be930fb-7762-464c-9cb5-8953db1612dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be930fb-7762-464c-9cb5-8953db1612dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f51c14-9414-4b84-b27b-4ec2b44768a2', 'volume_name': 'volume-26f51c14-9414-4b84-b27b-4ec2b44768a2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d18bdb-6e80-421d-a6b8-7b62ca870ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d18bdb-6e80-421d-a6b8-7b62ca870ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c43764d-a966-497d-9072-c9a2be54fa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:49:59 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Volume 26f51c14-9414-4b84-b27b-4ec2b44768a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f51c14-9414-4b84-b27b-4ec2b44768a2', 'volume_size': 1} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:49:59 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a 1G" returned: 0 in 0.518s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e588a018-819d-4803-9ec1-91998e803b54 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:59 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e588a018-819d-4803-9ec1-91998e803b54 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a Aug 11 06:49:59 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:59 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e588a018-819d-4803-9ec1-91998e803b54 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a" returned: 0 in 0.336s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:49:59 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a is being set with open permissions: ugo+rw Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:49:59 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a Aug 11 06:49:59 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (83b6e91b-b161-43ba-8974-fded9d49398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:49:59 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5ed60-1aed-445f-9e98-8fccb6889624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5ed60-1aed-445f-9e98-8fccb6889624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612280646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:00Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683e462-bade-44af-b748-676897a63f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683e462-bade-44af-b748-676897a63f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae18a1-8f1f-481d-82c9-ee11e33360b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ae18a1-8f1f-481d-82c9-ee11e33360b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce', 'volume_name': 'volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d82b12f-5aaf-423b-a80c-ee4db89c6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d82b12f-5aaf-423b-a80c-ee4db89c6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b2f11f-f9b0-4b11-aa76-481c2c504990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Volume 8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce', 'volume_size': 1} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:00 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:00 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info Aug 11 06:50:00 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:00 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (decdda50-942c-4a5b-b4d1-df1599dcfd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c839e2d-6b83-4bc9-a413-660bf176a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info" returned: 0 in 0.322s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:00 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info is being set with open permissions: ugo+rw Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c839e2d-6b83-4bc9-a413-660bf176a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485258118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:00Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info Aug 11 06:50:00 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e3c498-46f8-4c7c-a295-43a448b3acf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e3c498-46f8-4c7c-a295-43a448b3acf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662e6d6c-6e98-40ba-bb81-0a1952d2398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662e6d6c-6e98-40ba-bb81-0a1952d2398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44', 'volume_name': 'volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289e05ff-3bd4-4634-a425-0bd41f6b5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289e05ff-3bd4-4634-a425-0bd41f6b5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c087205c-56e5-4073-a30a-34da7ef77340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:00 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Volume f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44', 'volume_size': 1} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:00 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.info" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442018474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f51c14-9414-4b84-b27b-4ec2b44768a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555c0bc82c814b25bdfb4bcb8583a965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:49:59Z,use_quota=True,user_id='f1457708ec9e43c69faa0d89633bbb65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Creating volume 26f51c14-9414-4b84-b27b-4ec2b44768a2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:00 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:00 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:00 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 1073741824 Aug 11 06:50:00 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:00 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-be175b64-79de-43d3-ab4e-9b44d3c2027d tempest-ProjectReaderTests-313516393 None] Create snapshot completed successfully Aug 11 06:50:01 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 1073741824" returned: 0 in 0.522s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:01 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 Aug 11 06:50:01 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:01 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2" returned: 0 in 0.264s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.530s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1612280646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fb9be662044748b0b59549a5f1f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:00Z,use_quota=True,user_id='3d1b74d1b26e4e63bdb9ef0273e12815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Creating volume 8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:01 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:01 devstack sudo[114649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce 1073741824 Aug 11 06:50:01 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c43764d-a966-497d-9072-c9a2be54fa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f51c14-9414-4b84-b27b-4ec2b44768a2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d22dfae-f62b-44e3-8248-dfd951d6fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:01 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Volume volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 (26f51c14-9414-4b84-b27b-4ec2b44768a2): created successfully Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d22dfae-f62b-44e3-8248-dfd951d6fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Flow 'volume_create_manager' (e4f85dbe-558d-4206-8bfd-64cba0759fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:01 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-36ea2ef2-4275-4cb1-b03a-c1c51ddbf9a5 tempest-ProjectReaderTests-89268778 None] Created volume successfully. Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-f223d0af-d442-4a82-abaa-f7f0b466c82a-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-f223d0af-d442-4a82-abaa-f7f0b466c82a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-f223d0af-d442-4a82-abaa-f7f0b466c82a" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-f223d0af-d442-4a82-abaa-f7f0b466c82a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Deleting offline snapshot f223d0af-d442-4a82-abaa-f7f0b466c82a of volume e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] snapshot_file for this snap is: volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5050fb09-02af-4132-9ee2-7cefb50efe19]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:01 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:01 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a Aug 11 06:50:01 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:02 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce 1073741824" returned: 0 in 0.516s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:02 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce Aug 11 06:50:02 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:02 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a" returned: 0 in 0.450s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e588a018-819d-4803-9ec1-91998e803b54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d6298-8cf7-4746-ad0a-7ba9e96b8e29]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:02 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" returned: 0 in 0.269s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:02 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 Aug 11 06:50:02 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485258118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:00Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Creating volume f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:02 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b2f11f-f9b0-4b11-aa76-481c2c504990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:02 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 1073741824 Aug 11 06:50:02 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738b7644-8253-4b68-9fa2-4d97ab2f3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:02 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Volume volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce (8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce): created successfully Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738b7644-8253-4b68-9fa2-4d97ab2f3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Flow 'volume_create_manager' (83b6e91b-b161-43ba-8974-fded9d49398d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:02 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-70085b19-ab98-406f-94af-36410dc3c30e tempest-ProjectReaderTests-202926630 None] Created volume successfully. Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Acquiring lock "cinder-26f51c14-9414-4b84-b27b-4ec2b44768a2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "cinder-26f51c14-9414-4b84-b27b-4ec2b44768a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Acquiring lock "cinder-quobyte-26f51c14-9414-4b84-b27b-4ec2b44768a2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "cinder-quobyte-26f51c14-9414-4b84-b27b-4ec2b44768a2" acquired by "delete_volume" :: waited 0.014s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cad1dc-2577-4158-913b-9677b70a1344]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:02 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 Aug 11 06:50:02 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:02 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54" returned: 0 in 0.500s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:02 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:02 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a Aug 11 06:50:02 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 1073741824" returned: 0 in 0.668s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2" returned: 0 in 0.450s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2 Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:03 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "cinder-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:03 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 Aug 11 06:50:03 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Acquiring lock "cinder-quobyte-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4783c6-7100-454a-a7dc-76bebb280709]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a" returned: 0 in 0.541s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a Aug 11 06:50:03 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce Aug 11 06:50:03 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-26f51c14-9414-4b84-b27b-4ec2b44768a2" returned: 0 in 0.346s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" returned: 0 in 0.329s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "cinder-quobyte-26f51c14-9414-4b84-b27b-4ec2b44768a2" released by "delete_volume" :: held 0.864s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c087205c-56e5-4073-a30a-34da7ef77340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a878a31a-fb90-406d-8c1b-a542ddd7df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:03 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Volume volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 (f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44): created successfully Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a878a31a-fb90-406d-8c1b-a542ddd7df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (decdda50-942c-4a5b-b4d1-df1599dcfd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-dceedde0-c977-4868-82bf-38f170c5ad64 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Created reservations ['1a287ed1-603f-44a1-bfad-c5acf8a20561', '53d86891-164a-45ed-b281-5c00c6dd112b', 'f9143f31-239d-4afc-8ed1-0fa07751f8c7', '5b5ea4ff-8765-4e03-8b6a-4acf27ca4c5b'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:03 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54.f223d0af-d442-4a82-abaa-f7f0b466c82a" returned: 0 in 0.320s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-f223d0af-d442-4a82-abaa-f7f0b466c82a" released by "_delete_snapshot" :: held 1.910s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" released by "delete_snapshot" :: held 1.941s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:03 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" returned: 0 in 0.474s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:03 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce Aug 11 06:50:03 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Created reservations ['b454e814-036f-40d9-b580-67214dafd711', '6237bdad-5edf-4d41-a7cf-641d54dafaf8', 'd1902caf-6bf4-4c66-aa28-1130b03d5e29', '38b4595d-61db-44e5-a0fa-16c5a9c7b329'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:03 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Delete snapshot completed successfully. Aug 11 06:50:03 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-905c2ba7-a00d-42bc-b524-39c2c215aede tempest-ProjectReaderTests-313516393 None] Lock "cinder-f223d0af-d442-4a82-abaa-f7f0b466c82a-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:04 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.359s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:04 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" returned: 0 in 0.317s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Deleted volume successfully. Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "cinder-quobyte-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce" released by "delete_volume" :: held 0.842s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ceddeab8-0ded-4476-aacd-4358d3254f44 tempest-ProjectReaderTests-89268778 None] Lock "cinder-26f51c14-9414-4b84-b27b-4ec2b44768a2-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Created reservations ['208cc246-6597-49a4-89b9-321e36ce0be0', 'ad91c6db-4755-4e8b-b841-d000550aea02', '9c171c3a-121e-4b58-ba13-b13bd393f9e4', '3738c849-ff9f-4477-94b4-c65c6ebbe1c3'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:04 devstack sudo[114703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:04 devstack sudo[114703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:04 devstack sudo[114703]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:04 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Deleted volume successfully. Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-76d573b2-775b-4c9a-80e9-55fa6b2cad57 tempest-ProjectReaderTests-202926630 None] Lock "cinder-8d19d71e-aaa0-4b86-ac84-3fb4dd0250ce-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:04 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Creating offline snapshot 60d1a251-739b-4f7a-b25c-937c3d6bbb4e of volume f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-e588a018-819d-4803-9ec1-91998e803b54-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be7e7be-59a4-40ad-ab2f-494cf6049eae]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "cinder-e588a018-819d-4803-9ec1-91998e803b54-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[9878980f-c980-46ed-8b0e-f5676d84b080]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:05 devstack sudo[114706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 Aug 11 06:50:05 devstack sudo[114706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:05 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 Aug 11 06:50:05 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:05 devstack sudo[114706]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" returned: 0 in 0.587s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:05 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e 1G Aug 11 06:50:05 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:05 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54" returned: 0 in 0.550s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:05 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:05 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54 Aug 11 06:50:05 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:06 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e588a018-819d-4803-9ec1-91998e803b54" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-e588a018-819d-4803-9ec1-91998e803b54" released by "delete_volume" :: held 1.082s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:06 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e 1G" returned: 0 in 0.648s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:06 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e Aug 11 06:50:06 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Created reservations ['73298d54-1a0f-4104-8c22-7dc8152d92b2', '06bfe9c9-9335-42fa-9397-3d129c9b0aac', 'b87bebdd-3d20-4654-a2b1-b6c7fe009d35', 'f54c79c3-97de-4309-a256-12cc10f67dd2'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:06 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:06 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:06 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e" returned: 0 in 0.434s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:06 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e is being set with open permissions: ugo+rw Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:06 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e Aug 11 06:50:06 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:06 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.306s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:06 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Deleted volume successfully. Aug 11 06:50:06 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-799ee9d3-b535-43cc-9741-5a4adc226ecc tempest-ProjectReaderTests-313516393 None] Lock "cinder-e588a018-819d-4803-9ec1-91998e803b54-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:07 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e" returned: 0 in 0.366s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:07 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info Aug 11 06:50:07 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:07 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info" returned: 0 in 0.295s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:07 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info is being set with open permissions: ugo+rw Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:07 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info Aug 11 06:50:07 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:07 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.info" returned: 0 in 0.303s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:07 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8c0b0061-94dc-4bdb-8ef2-c1b744a07a85 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (77b45ef5-8c6d-4c2c-8840-45f941f0f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b26284-8348-4f91-bae7-f298c2c4badd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b26284-8348-4f91-bae7-f298c2c4badd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418271786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298dce5-b8da-440b-9349-33309b3c0fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:08Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5caa25-41df-40ec-b41e-f9b368d6dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5caa25-41df-40ec-b41e-f9b368d6dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb692c2-97aa-4ad6-8ccd-aeb6c8136621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb692c2-97aa-4ad6-8ccd-aeb6c8136621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4298dce5-b8da-440b-9349-33309b3c0fc2', 'volume_name': 'volume-4298dce5-b8da-440b-9349-33309b3c0fc2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3baec24-8cd2-4ae9-a14c-a7cbcded7e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3baec24-8cd2-4ae9-a14c-a7cbcded7e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351fa158-eebf-4681-a48a-970233174b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:07 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Volume 4298dce5-b8da-440b-9349-33309b3c0fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4298dce5-b8da-440b-9349-33309b3c0fc2', 'volume_size': 1} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418271786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298dce5-b8da-440b-9349-33309b3c0fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cac47b8b6de4afea9d6427115dbd5df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:08Z,use_quota=True,user_id='e96f4f936dd54d9da065e86b75e1312b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Creating volume 4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:07 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:07 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:07 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 1073741824 Aug 11 06:50:07 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-60d1a251-739b-4f7a-b25c-937c3d6bbb4e-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-60d1a251-739b-4f7a-b25c-937c3d6bbb4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-60d1a251-739b-4f7a-b25c-937c3d6bbb4e" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-60d1a251-739b-4f7a-b25c-937c3d6bbb4e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot 60d1a251-739b-4f7a-b25c-937c3d6bbb4e of volume f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbaa81d-1547-4afc-8574-4e3743b09809]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:08 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e Aug 11 06:50:08 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:08 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 1073741824" returned: 0 in 0.609s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:08 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 Aug 11 06:50:08 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:08 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e" returned: 0 in 0.476s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ccebc-c675-48cf-9661-d1ab2e33ee53]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:08 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351fa158-eebf-4681-a48a-970233174b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4298dce5-b8da-440b-9349-33309b3c0fc2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4b0f1d-e14d-49a1-970b-e67d0803bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:08 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Volume volume-4298dce5-b8da-440b-9349-33309b3c0fc2 (4298dce5-b8da-440b-9349-33309b3c0fc2): created successfully Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4b0f1d-e14d-49a1-970b-e67d0803bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:08 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Flow 'volume_create_manager' (77b45ef5-8c6d-4c2c-8840-45f941f0f22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:08 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3fc88063-44f3-4898-983c-cdfb390901f1 tempest-ProjectReaderTests-313516393 None] Created volume successfully. Aug 11 06:50:08 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 Aug 11 06:50:08 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:09 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" returned: 0 in 0.437s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:09 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e Aug 11 06:50:09 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:09 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e" returned: 0 in 0.360s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:09 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e Aug 11 06:50:09 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:09 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:09 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44.60d1a251-739b-4f7a-b25c-937c3d6bbb4e" returned: 0 in 0.311s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-60d1a251-739b-4f7a-b25c-937c3d6bbb4e" released by "_delete_snapshot" :: held 1.725s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" released by "delete_snapshot" :: held 1.765s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Created reservations ['346b3135-b461-4fa7-9a29-fcaa0249ea62', '9a871667-1304-4cd8-b48f-fb1782721a89', 'e50a696f-b410-468a-bfe3-6f120167ab6b', 'e989dc61-72d3-4fb2-8da4-9bd080d565f0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Creating offline snapshot 8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 of volume 4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bde6c-d227-4963-be68-d566e1767ea3]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:10 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-ce3830c4-32e3-45db-9ae1-14fcd0f419c0 tempest-ProjectMemberTests-478824 None] Lock "cinder-60d1a251-739b-4f7a-b25c-937c3d6bbb4e-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:10 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 Aug 11 06:50:10 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "cinder-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" acquired by "delete_volume" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a332e44-0317-44e2-acbb-18a2624475b4]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:10 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2" returned: 0 in 0.459s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:10 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 Aug 11 06:50:10 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:10 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 1G Aug 11 06:50:10 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:10 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" returned: 0 in 0.424s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:10 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:10 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44 Aug 11 06:50:10 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:11 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 1G" returned: 0 in 0.482s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298dce5-b8da-440b-9349-33309b3c0fc2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:11 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298dce5-b8da-440b-9349-33309b3c0fc2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 Aug 11 06:50:11 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:11 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" returned: 0 in 0.301s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44" released by "delete_volume" :: held 0.803s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Created reservations ['e24f3af7-cd6b-4e50-b445-c9a97f8417fa', 'f25f26b6-2f0f-4d16-97bd-78c025badd4e', '2faff61e-7b08-4481-a0d2-39d10dc81f62', 'b4e0460e-1b38-4ef4-8b58-92fe6ba7ff35'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:11 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298dce5-b8da-440b-9349-33309b3c0fc2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" returned: 0 in 0.334s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:11 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 is being set with open permissions: ugo+rw Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:11 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:11 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:11 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 Aug 11 06:50:11 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:11 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:11 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:50:11 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-a82ee370-5685-43b3-8793-d27cc0f46848 tempest-ProjectMemberTests-478824 None] Lock "cinder-f2675a2a-9cfa-4eb6-b6aa-a4b922a9fa44-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:11 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:11 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info Aug 11 06:50:11 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:12 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info" returned: 0 in 0.343s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:12 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info is being set with open permissions: ugo+rw Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:12 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info Aug 11 06:50:12 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (20f75463-a3fd-438c-9e0b-ed05d80fb920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f25bc7-ac00-4feb-b066-36738b743e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f25bc7-ac00-4feb-b066-36738b743e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564579571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:12Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2884e42-8f39-4ea8-ace2-09c62e078cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2884e42-8f39-4ea8-ace2-09c62e078cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d10295-922c-4a95-9ebc-d6166a71cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d10295-922c-4a95-9ebc-d6166a71cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405', 'volume_name': 'volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72815aa-e2c6-492a-a167-db50e7243693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72815aa-e2c6-492a-a167-db50e7243693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e7be76-ae4e-45e6-aa52-67e9c9a91215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:12 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Volume ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405', 'volume_size': 1} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:12 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.info" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564579571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:12Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Creating volume ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:12 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:12 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 1073741824 Aug 11 06:50:12 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:12 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-ae266a19-76f3-4ef1-8cce-1013ff820b7b tempest-ProjectReaderTests-313516393 None] Create snapshot completed successfully Aug 11 06:50:12 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 1073741824" returned: 0 in 0.454s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:12 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:12 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 Aug 11 06:50:13 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:13 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" returned: 0 in 0.363s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e7be76-ae4e-45e6-aa52-67e9c9a91215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373ff509-7f19-41e1-9c62-0cfc38316655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:13 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Volume volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 (ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405): created successfully Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (373ff509-7f19-41e1-9c62-0cfc38316655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (20f75463-a3fd-438c-9e0b-ed05d80fb920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:13 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c7f56a40-4dbf-4e5e-a8c8-1f10739ed0e0 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Deleting offline snapshot 8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 of volume 4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] snapshot_file for this snap is: volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db00660-69af-4b75-b746-585425722cf7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:13 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 Aug 11 06:50:13 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:13 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" returned: 0 in 0.360s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4298dce5-b8da-440b-9349-33309b3c0fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[63865632-f4af-474f-9b5e-3664ef3ac2b8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:13 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:14 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 Aug 11 06:50:14 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:14 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:14 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 Aug 11 06:50:14 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Creating offline snapshot bc980240-32cf-4d8f-a36b-a09978886d73 of volume ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc389aa-898d-41b8-b8d7-36e08d762cb6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:14 devstack sudo[114833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 Aug 11 06:50:14 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:14 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" returned: 0 in 0.474s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:14 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:14 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95 Aug 11 06:50:14 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:15 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" returned: 0 in 0.440s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:15 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 1G Aug 11 06:50:15 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:15 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:15 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:15 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2.8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" returned: 0 in 0.394s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95" released by "_delete_snapshot" :: held 1.811s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" released by "delete_snapshot" :: held 1.850s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Created reservations ['4a3603c7-3c93-4f3c-96a2-044122f93367', '00c6b496-9421-402b-b8e6-5e31841d1497', '7c4d188e-904b-42c4-b9ea-6fa561aabb59', '709744cb-3af8-4c86-9094-4551f003a12e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:15 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Delete snapshot completed successfully. Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b841c79e-fc05-4bab-8870-301c5dd6539b tempest-ProjectReaderTests-313516393 None] Lock "cinder-8eaeaba9-c719-4d1b-b645-b2c4f4ca6f95-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:15 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.508s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-4298dce5-b8da-440b-9349-33309b3c0fc2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "cinder-4298dce5-b8da-440b-9349-33309b3c0fc2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Acquiring lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" acquired by "delete_volume" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:15 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 1G" returned: 0 in 0.689s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[8453840d-d56f-44ea-894d-e56b5d92bf5c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:15 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 Aug 11 06:50:15 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:15 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 Aug 11 06:50:15 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:16 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73" returned: 0 in 0.386s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:16 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 is being set with open permissions: ugo+rw Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:16 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 Aug 11 06:50:16 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:16 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2" returned: 0 in 0.459s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:16 devstack sudo[114863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2 Aug 11 06:50:16 devstack sudo[114863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:16 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73" returned: 0 in 0.324s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:16 devstack sudo[114863]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-4298dce5-b8da-440b-9349-33309b3c0fc2" returned: 0 in 0.285s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:16 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info Aug 11 06:50:16 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "cinder-quobyte-4298dce5-b8da-440b-9349-33309b3c0fc2" released by "delete_volume" :: held 0.832s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Created reservations ['ebc4399a-d2db-4655-a04d-b54c2e519e06', 'cf12fa2f-b5a2-4635-96fc-d7ea9677067d', 'a8c2e73a-c85a-4f6e-877f-c4aefa210ace', 'dc95f05c-0b07-4027-b6e6-d920a04d2e1e'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:16 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:16 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:16 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info" returned: 0 in 0.330s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:16 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info is being set with open permissions: ugo+rw Aug 11 06:50:16 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:16 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info Aug 11 06:50:16 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:17 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.345s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Deleted volume successfully. Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-082f5f75-0a57-4ab8-9fd3-b377223f9714 tempest-ProjectReaderTests-313516393 None] Lock "cinder-4298dce5-b8da-440b-9349-33309b3c0fc2-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:17 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.info" returned: 0 in 0.426s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:17 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-a16493e2-ede1-433a-85c3-94d607643dcd tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-bc980240-32cf-4d8f-a36b-a09978886d73-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-bc980240-32cf-4d8f-a36b-a09978886d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-bc980240-32cf-4d8f-a36b-a09978886d73" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bc980240-32cf-4d8f-a36b-a09978886d73" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:17 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Deleting offline snapshot bc980240-32cf-4d8f-a36b-a09978886d73 of volume ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[d854ebe2-3628-4393-bdea-3511e69d80cf]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:18 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 Aug 11 06:50:18 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:18 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73" returned: 0 in 0.468s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eec9f3-62f7-4e5d-a94c-cd8b12cc18d7]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:18 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:18 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 Aug 11 06:50:18 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:19 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" returned: 0 in 0.489s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:19 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 Aug 11 06:50:19 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:19 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73" returned: 0 in 0.430s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:19 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73 Aug 11 06:50:19 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:19 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405.bc980240-32cf-4d8f-a36b-a09978886d73" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bc980240-32cf-4d8f-a36b-a09978886d73" released by "_delete_snapshot" :: held 1.832s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" released by "delete_snapshot" :: held 1.869s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=197,cinder:INSERT=65,cinder:UPDATE=249,cinder:DELETE=23 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:INSERT=70,cinder:UPDATE=261,cinder:SELECT=181,cinder:DELETE=21 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Created reservations ['643b3254-f1b1-4aa6-b8b5-1e5f3d9c6062', 'f977a533-24e3-437a-b5a9-c00a132aa1a3', '8cb3e86b-b3f6-4d6f-a921-8b535dd06e4e', 'a5f4c767-6ffa-4426-908a-b4ed5636274d'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:19 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:50:19 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-43f891ad-dd4c-48ea-be99-83d478d3998c tempest-ProjectMemberTests-478824 None] Lock "cinder-bc980240-32cf-4d8f-a36b-a09978886d73-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "cinder-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f71558-70e4-4530-bfec-9f5793505a9c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:20 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 Aug 11 06:50:20 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:20 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" returned: 0 in 0.490s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:20 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:20 devstack sudo[114946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405 Aug 11 06:50:20 devstack sudo[114946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:21 devstack sudo[114946]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" returned: 0 in 0.308s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405" released by "delete_volume" :: held 0.915s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Created reservations ['6f41c3f0-8e19-4208-a092-e4c77528cc24', '960c6954-5886-4ad2-a29b-60e0a654e31f', '7a83d14c-c87e-4ea1-bcd0-711f8c690ae7', '084a0272-9533-445c-9465-13e182be42b5'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:21 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:21 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:21 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.316s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:21 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:50:21 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-f995b92e-f2cc-49a3-ac22-659a74e08474 tempest-ProjectMemberTests-478824 None] Lock "cinder-ef4a7bf0-cd85-4ea9-9355-3a35bf7e7405-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (c0e2725f-1789-479f-80a2-31270a7718f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce39958-809e-4123-ab57-b45e417b8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce39958-809e-4123-ab57-b45e417b8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922082690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9508ae5d-3c0d-4b16-bf78-9777a5045d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:23Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb60b6-8460-4b44-9122-6a2fd80b4f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fb60b6-8460-4b44-9122-6a2fd80b4f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539768d-d258-46b1-8a46-7dcd6e70e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539768d-d258-46b1-8a46-7dcd6e70e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9508ae5d-3c0d-4b16-bf78-9777a5045d48', 'volume_name': 'volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a22e1e-7303-4a82-aee8-9c63b72c3b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a22e1e-7303-4a82-aee8-9c63b72c3b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2158897d-6460-4d04-8577-a30aa6cb7a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:23 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Volume 9508ae5d-3c0d-4b16-bf78-9777a5045d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48', 'volume_size': 1} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922082690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9508ae5d-3c0d-4b16-bf78-9777a5045d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:23Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Creating volume 9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:23 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:23 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 1073741824 Aug 11 06:50:23 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:23 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 1073741824" returned: 0 in 0.578s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:23 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:23 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 Aug 11 06:50:23 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:24 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48" returned: 0 in 0.313s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2158897d-6460-4d04-8577-a30aa6cb7a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebfc793-1898-49ba-a394-ab9756bfe33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:24 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Volume volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 (9508ae5d-3c0d-4b16-bf78-9777a5045d48): created successfully Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebfc793-1898-49ba-a394-ab9756bfe33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:24 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (c0e2725f-1789-479f-80a2-31270a7718f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:24 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c38b5588-f2d9-46c2-ab99-f8f42dae0509 tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:50:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:25 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Creating offline snapshot bf038fac-68fd-4499-8a9c-c7c9c8407756 of volume 9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:25 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f4da81-6970-4411-b455-acb72a78ff2d]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:25 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:25 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 Aug 11 06:50:25 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:26 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48" returned: 0 in 0.457s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:26 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 1G Aug 11 06:50:26 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:26 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 1G" returned: 0 in 0.494s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:26 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 Aug 11 06:50:26 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:26 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756" returned: 0 in 0.334s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:26 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 is being set with open permissions: ugo+rw Aug 11 06:50:26 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:26 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 Aug 11 06:50:26 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:27 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:27 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info Aug 11 06:50:27 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:27 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info" returned: 0 in 0.348s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:27 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info is being set with open permissions: ugo+rw Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:27 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info Aug 11 06:50:27 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:27 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.info" returned: 0 in 0.390s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:27 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:28 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-c608ed9d-6183-431a-977a-c0378adf3047 tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-bf038fac-68fd-4499-8a9c-c7c9c8407756-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-bf038fac-68fd-4499-8a9c-c7c9c8407756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-bf038fac-68fd-4499-8a9c-c7c9c8407756" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bf038fac-68fd-4499-8a9c-c7c9c8407756" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot bf038fac-68fd-4499-8a9c-c7c9c8407756 of volume 9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b896629c-c599-4dcc-a4e0-59864a964c83]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:28 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:28 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 Aug 11 06:50:28 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:29 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756" returned: 0 in 0.466s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2e4f9-10fd-4543-8e43-2f2d59503be2]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:29 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 Aug 11 06:50:29 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:29 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48" returned: 0 in 0.408s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:29 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:29 devstack sudo[114999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 Aug 11 06:50:29 devstack sudo[114999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:30 devstack sudo[114999]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756" returned: 0 in 0.417s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:30 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756 Aug 11 06:50:30 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:30 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48.bf038fac-68fd-4499-8a9c-c7c9c8407756" returned: 0 in 0.290s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-bf038fac-68fd-4499-8a9c-c7c9c8407756" released by "_delete_snapshot" :: held 1.701s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" released by "delete_snapshot" :: held 1.728s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Created reservations ['7e59af23-3e06-42ed-8eae-19e8aa9768b9', '3790a108-8777-4135-8971-666d1a59d8c4', '50f53b07-0aba-438f-93d8-d77d3a8449bc', 'e88a3e18-37e8-423b-bc08-e93c35e751b0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:30 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5526eb4a-5710-4b22-affd-f465c03893f8 tempest-ProjectMemberTests-478824 None] Lock "cinder-bf038fac-68fd-4499-8a9c-c7c9c8407756-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-9508ae5d-3c0d-4b16-bf78-9777a5045d48-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "cinder-9508ae5d-3c0d-4b16-bf78-9777a5045d48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:30 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" acquired by "delete_volume" :: waited 0.023s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6537e-1f08-40c4-816c-78b4d1ebf8b0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:31 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 Aug 11 06:50:31 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:31 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48" returned: 0 in 0.396s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:31 devstack sudo[115015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48 Aug 11 06:50:31 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:31 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-9508ae5d-3c0d-4b16-bf78-9777a5045d48" returned: 0 in 0.284s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-9508ae5d-3c0d-4b16-bf78-9777a5045d48" released by "delete_volume" :: held 0.749s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Created reservations ['7bf024c8-d2f3-4531-b405-05776a303f23', '9a6af81e-b154-4cc3-a224-b223c819e0d3', '84e41f6e-8ae0-4577-bfbc-699d33d3671a', '67ce05de-2c93-4aad-9a6c-f1ceeba202d9'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Flow 'volume_create_manager' (7391753f-936c-4fc4-b1c8-3e9b59a29e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233ba24a-fdbf-4d00-8bdb-1b3565c05315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233ba24a-fdbf-4d00-8bdb-1b3565c05315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1519106357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c9a1df-65b9-4fa7-abe1-fa9c387c16a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8a30a8008c4cf58e39d10fa384620a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:32Z,use_quota=True,user_id='cb805520735046cfad3a5dcd28eb730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e0e393-b388-432d-abb2-8c47bfcb1857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e0e393-b388-432d-abb2-8c47bfcb1857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c457ef-ff4b-4a16-a7a1-c410c4cb234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c457ef-ff4b-4a16-a7a1-c410c4cb234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c9a1df-65b9-4fa7-abe1-fa9c387c16a2', 'volume_name': 'volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bafd96-1701-4784-bae6-3f9610901ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bafd96-1701-4784-bae6-3f9610901ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691e240c-28d6-4d89-a11a-e730d08e4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:31 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Volume 39c9a1df-65b9-4fa7-abe1-fa9c387c16a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2', 'volume_size': 1} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1519106357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c9a1df-65b9-4fa7-abe1-fa9c387c16a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8a30a8008c4cf58e39d10fa384620a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:32Z,use_quota=True,user_id='cb805520735046cfad3a5dcd28eb730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Creating volume 39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:31 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:31 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 1073741824 Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:31 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:31 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:31 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:31 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:32 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-b9d83ab2-6893-446d-ac80-c5c9fc348ebd tempest-ProjectMemberTests-478824 None] Lock "cinder-9508ae5d-3c0d-4b16-bf78-9777a5045d48-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:32 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 1073741824" returned: 0 in 0.500s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:32 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:32 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (1dd756f2-6016-4ded-8ae8-62a8d440be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155972ea-c881-40da-866b-d9de48e3a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155972ea-c881-40da-866b-d9de48e3a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030087052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2323265-7da6-42c1-8c38-112821fd6363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:32Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcc3636-feec-457e-aa0e-55c80ca5e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fcc3636-feec-457e-aa0e-55c80ca5e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314539b3-8b96-4054-bfc4-334a619205d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314539b3-8b96-4054-bfc4-334a619205d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2323265-7da6-42c1-8c38-112821fd6363', 'volume_name': 'volume-e2323265-7da6-42c1-8c38-112821fd6363', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09692f9f-aa2f-4d27-922f-b76df2385549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09692f9f-aa2f-4d27-922f-b76df2385549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b48f65-b323-4033-8909-37d806e6bb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Volume e2323265-7da6-42c1-8c38-112821fd6363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2323265-7da6-42c1-8c38-112821fd6363', 'volume_size': 1} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:32 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.085s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030087052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2323265-7da6-42c1-8c38-112821fd6363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7505560adea4fd88b9659ae28b2e432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:32Z,use_quota=True,user_id='4bb9b4e5b86147198baa9146147bf793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)}" {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Creating volume e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:32 devstack cinder-volume[94463]: INFO cinder.volume.drivers.remotefs [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] casted to osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 1073741824 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:32 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 1073741824 Aug 11 06:50:32 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691e240c-28d6-4d89-a11a-e730d08e4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ad521-968b-4548-afc6-b333eb369e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:32 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Volume volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 (39c9a1df-65b9-4fa7-abe1-fa9c387c16a2): created successfully Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ad521-968b-4548-afc6-b333eb369e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:32 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Flow 'volume_create_manager' (7391753f-936c-4fc4-b1c8-3e9b59a29e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:32 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b7cd6bd8-7c73-46cc-b565-25397a472878 tempest-SnapshotDependencyTests-1153703375 None] Created volume successfully. Aug 11 06:50:33 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 1073741824" returned: 0 in 0.491s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:33 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 Aug 11 06:50:33 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:33 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'} {{(pid=94463) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b48f65-b323-4033-8909-37d806e6bb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2323265-7da6-42c1-8c38-112821fd6363', 'volume_size': 1}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3de84c-45af-4e46-9430-9cab7fddf6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:33 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Volume volume-e2323265-7da6-42c1-8c38-112821fd6363 (e2323265-7da6-42c1-8c38-112821fd6363): created successfully Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3de84c-45af-4e46-9430-9cab7fddf6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:33 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Flow 'volume_create_manager' (1dd756f2-6016-4ded-8ae8-62a8d440be91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:33 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-b5ec2beb-2d79-4f80-804e-59be81946efa tempest-ProjectMemberTests-478824 None] Created volume successfully. Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Creating offline snapshot dd5b174f-5423-43ab-8f85-711117e4f445 of volume 39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03b5c5-3489-448d-9535-21bf48780556]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:34 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:34 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:34 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.380s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:34 devstack sudo[115045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 1G Aug 11 06:50:34 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:34 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 1G" returned: 0 in 0.442s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:34 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:34 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:34 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:35 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.304s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:35 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 is being set with open permissions: ugo+rw Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:35 devstack sudo[115055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:35 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:35 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.241s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:35 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info Aug 11 06:50:35 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:35 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info" returned: 0 in 0.251s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:35 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info is being set with open permissions: ugo+rw Aug 11 06:50:35 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:35 devstack sudo[115061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info Aug 11 06:50:35 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:36 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.info" returned: 0 in 0.245s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.233s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Creating offline snapshot 8d53bf91-481d-44b6-b893-efc516df4429 of volume e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 11 06:50:36 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-de560913-2208-4ab0-aef2-97ab9fdb4267 tempest-SnapshotDependencyTests-1153703375 None] Create snapshot completed successfully Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf96663-2004-4de7-a28c-daa268de4812]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:36 devstack sudo[115064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 Aug 11 06:50:36 devstack sudo[115064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:36 devstack sudo[115064]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363" returned: 0 in 0.389s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 1G {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:36 devstack sudo[115069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 1G Aug 11 06:50:36 devstack sudo[115069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.flows.manager.create_volume [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94463) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Flow 'volume_create_manager' (73a30832-a7a0-4891-ac91-7e85b4ae8865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97caf51-ea7a-4293-8d49-f1d481f42e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97caf51-ea7a-4293-8d49-f1d481f42e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-11T04:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0974006d-9e6c-476a-ba61-e2b99e8895c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8a30a8008c4cf58e39d10fa384620a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-11T04:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd5b174f-5423-43ab-8f85-711117e4f445,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-11T04:50:37Z,use_quota=True,user_id='cb805520735046cfad3a5dcd28eb730f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa7c3649-5970-48dd-beb6-3863474c08c7),volume_type_id=aa7c3649-5970-48dd-beb6-3863474c08c7)' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c8d4e7-1ee6-4f2e-a205-191446e1fcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c8d4e7-1ee6-4f2e-a205-191446e1fcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb72f3b8-8346-46aa-9d71-7c2d19480211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb72f3b8-8346-46aa-9d71-7c2d19480211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0974006d-9e6c-476a-ba61-e2b99e8895c3', 'volume_name': 'volume-0974006d-9e6c-476a-ba61-e2b99e8895c3', 'volume_size': 1, 'snapshot_id': 'dd5b174f-5423-43ab-8f85-711117e4f445'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a10533-44da-45be-9788-7b727d11a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a10533-44da-45be-9788-7b727d11a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:36 devstack sudo[115069]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aacc3ec-1b46-47f1-9605-13986e20b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:36 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Volume 0974006d-9e6c-476a-ba61-e2b99e8895c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0974006d-9e6c-476a-ba61-e2b99e8895c3', 'volume_size': 1, 'snapshot_id': 'dd5b174f-5423-43ab-8f85-711117e4f445'} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 1G" returned: 0 in 0.483s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2323265-7da6-42c1-8c38-112821fd6363 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:36 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:36 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2323265-7da6-42c1-8c38-112821fd6363 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 Aug 11 06:50:36 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:37 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2323265-7da6-42c1-8c38-112821fd6363 -F qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429" returned: 0 in 0.279s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 is being set with open permissions: ugo+rw Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:37 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 Aug 11 06:50:37 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:37 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429" returned: 0 in 0.250s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:37 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info Aug 11 06:50:37 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:37 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info" returned: 0 in 0.307s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:37 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info is being set with open permissions: ugo+rw Aug 11 06:50:37 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:37 devstack sudo[115085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info Aug 11 06:50:37 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:38 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.info" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.130s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445-0974006d-9e6c-476a-ba61-e2b99e8895c3" by "_create_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445-0974006d-9e6c-476a-ba61-e2b99e8895c3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Creating volume 0974006d-9e6c-476a-ba61-e2b99e8895c3 from snapshot dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Selected osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744 as target Quobyte volume. {{(pid=94463) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" by "_copy_volume_from_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:38 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-bd35fdb5-e544-4bcb-8d51-8347fa99321a tempest-ProjectMemberTests-478824 None] Create snapshot completed successfully Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] snapshot: dd5b174f-5423-43ab-8f85-711117e4f445, volume: 0974006d-9e6c-476a-ba61-e2b99e8895c3, {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[52957051-77b3-4568-b204-76f9b6be9ca6]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:38 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:38 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:38 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.408s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec96a45-d1dc-4df7-84d1-c09fc2f2ee81]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:38 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:38 devstack sudo[115093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:38 devstack sudo[115093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:39 devstack sudo[115093]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.417s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Creating direct copy from snapshot {{(pid=94463) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.utils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Path /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 not found in is_blk_device check {{(pid=94463) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:39 devstack sudo[115098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 Aug 11 06:50:39 devstack sudo[115098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-8d53bf91-481d-44b6-b893-efc516df4429-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-8d53bf91-481d-44b6-b893-efc516df4429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-8d53bf91-481d-44b6-b893-efc516df4429" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-8d53bf91-481d-44b6-b893-efc516df4429" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Deleting offline snapshot 8d53bf91-481d-44b6-b893-efc516df4429 of volume e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] snapshot_file for this snap is: volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77509c5-1a0a-4af6-95d5-9b4f704faabc]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:39 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 Aug 11 06:50:39 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:39 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429" returned: 0 in 0.587s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2323265-7da6-42c1-8c38-112821fd6363(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[695e4b30-d94c-4633-a7bf-4e3ae5d2639c]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:39 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:40 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 Aug 11 06:50:40 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:40 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363" returned: 0 in 0.808s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:40 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:40 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 Aug 11 06:50:40 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:41 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429" returned: 0 in 0.833s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:41 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:41 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429 Aug 11 06:50:41 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:42 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:42 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363.8d53bf91-481d-44b6-b893-efc516df4429" returned: 0 in 0.537s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-8d53bf91-481d-44b6-b893-efc516df4429" released by "_delete_snapshot" :: held 2.958s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" released by "delete_snapshot" :: held 2.987s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:42 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Created reservations ['47f14d76-fc71-42d3-bc0c-43d07114d4ea', '1d78ae2b-d769-44b3-8c34-fc80c24c0912', '96e85cf6-f8f0-441f-bf5d-d175006478d4', 'ca48c806-ddca-4bf9-b3b7-8a9caf1a97e0'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:42 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Delete snapshot completed successfully. Aug 11 06:50:42 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-5f6a1674-62a0-494d-b79f-7fb5da230a98 tempest-ProjectMemberTests-478824 None] Lock "cinder-8d53bf91-481d-44b6-b893-efc516df4429-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-e2323265-7da6-42c1-8c38-112821fd6363-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:43 devstack sudo[115098]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3" returned: 0 in 4.553s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.image.image_utils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Image conversion details: src /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 {{(pid=94463) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 11 06:50:43 devstack cinder-volume[94463]: INFO cinder.image.image_utils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Converted 1024.00 MB image at 224.87 MB/s Aug 11 06:50:43 devstack cinder-volume[94463]: WARNING cinder.volume.drivers.remotefs [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 is being set with open permissions: ugo+rw Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "cinder-e2323265-7da6-42c1-8c38-112821fd6363-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:43 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 Aug 11 06:50:43 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Acquiring lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" acquired by "delete_volume" :: waited 0.013s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee208318-0a2c-4886-984b-d6d5900767dd]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:43 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 Aug 11 06:50:43 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:43 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3" returned: 0 in 0.261s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" released by "_copy_volume_from_snapshot" :: held 5.737s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445-0974006d-9e6c-476a-ba61-e2b99e8895c3" released by "_create_volume_from_snapshot" :: held 5.814s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.841s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aacc3ec-1b46-47f1-9605-13986e20b873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0974006d-9e6c-476a-ba61-e2b99e8895c3', 'volume_size': 1, 'snapshot_id': 'dd5b174f-5423-43ab-8f85-711117e4f445'}' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:43 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced92fab-7644-4fac-b3c5-9be778d3230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 11 06:50:43 devstack cinder-volume[94463]: INFO cinder.volume.flows.manager.create_volume [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Volume volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 (0974006d-9e6c-476a-ba61-e2b99e8895c3): created successfully Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced92fab-7644-4fac-b3c5-9be778d3230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94463) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Flow 'volume_create_manager' (73a30832-a7a0-4891-ac91-7e85b4ae8865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94463) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 11 06:50:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-2661eb14-cbac-44e7-97a4-96616485de48 tempest-SnapshotDependencyTests-1153703375 None] Created volume successfully. Aug 11 06:50:44 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363" returned: 0 in 0.409s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:44 devstack sudo[115138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363 Aug 11 06:50:44 devstack sudo[115138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:44 devstack sudo[115138]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-e2323265-7da6-42c1-8c38-112821fd6363" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "cinder-quobyte-e2323265-7da6-42c1-8c38-112821fd6363" released by "delete_volume" :: held 0.755s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Created reservations ['5697239d-7dae-4cfe-a081-d4bd7211ff42', 'b6947544-7897-4a38-9ef8-c862f2b18972', '13f5563b-dc8d-418d-abe7-c5f8d37cf42f', '8f3a131e-1688-465b-aa7e-9af2ba59a266'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:44 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:44 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-dd5b174f-5423-43ab-8f85-711117e4f445-delete_snapshot" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-dd5b174f-5423-43ab-8f85-711117e4f445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" by "delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445" by "_delete_snapshot" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Deleting offline snapshot dd5b174f-5423-43ab-8f85-711117e4f445 of volume 39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] snapshot_file for this snap is: volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ae099-e2ac-4ed7-a698-c6c8061fd31b]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:44 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.289s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:44 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Deleted volume successfully. Aug 11 06:50:44 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-8ea35d8f-0430-46f8-a496-49d3eff3dad7 tempest-ProjectMemberTests-478824 None] Lock "cinder-e2323265-7da6-42c1-8c38-112821fd6363-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:45 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:45 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:45 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.450s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.remotefs [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94463) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce0fc6-389b-46ab-b421-cbcba81c0cc0]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:45 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:45 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:45 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.604s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:45 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:45 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:45 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:46 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.463s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:46 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445 Aug 11 06:50:46 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:46 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2.dd5b174f-5423-43ab-8f85-711117e4f445" returned: 0 in 0.283s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-dd5b174f-5423-43ab-8f85-711117e4f445" released by "_delete_snapshot" :: held 1.935s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" released by "delete_snapshot" :: held 1.962s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Created reservations ['2b3f41dd-ae86-482d-b55b-07a2d7a08fde', '229b4f0a-4721-42de-be92-29bdceb3fc2d', '26f6cff3-0bf9-45bd-9eb1-6375967e113d', '614ec9c3-a588-4c65-b1f3-6245817dfc9f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:46 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Delete snapshot completed successfully. Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-3f787aa9-e61d-45b8-84e8-80cffdd515a3 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-dd5b174f-5423-43ab-8f85-711117e4f445-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:46 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce2d6b-087c-452d-ad26-5106d09a46b8]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:47 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:47 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:47 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.383s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:47 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2 Aug 11 06:50:47 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:47 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" returned: 0 in 0.268s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2" released by "delete_volume" :: held 0.712s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Created reservations ['b6c9f27d-2d4c-4bbc-acfe-76241d5ec0c3', 'c4c6a851-b687-47cf-83c1-70a749994fba', '595cbb62-2821-4e65-8915-b431355c8ffe', '1a655b65-692b-40f4-b254-f6ce04a31ba7'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:47 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:47 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:47 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:48 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-0974006d-9e6c-476a-ba61-e2b99e8895c3-delete_volume" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.278s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:48 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Deleted volume successfully. Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-0974006d-9e6c-476a-ba61-e2b99e8895c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-9325b90d-0cf7-4167-9588-0558ec4a3542 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-39c9a1df-65b9-4fa7-abe1-fa9c387c16a2-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" by "delete_volume" {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" acquired by "delete_volume" :: waited 0.017s {{(pid=94463) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo.privsep.daemon [-] privsep: reply[500498aa-afba-4e0c-92ff-0c5dd1b67823]: (4, 'qcow2') {{(pid=95913) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:48 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 Aug 11 06:50:48 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:48 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3" returned: 0 in 0.358s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:48 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3 Aug 11 06:50:48 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:48 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b/volume-0974006d-9e6c-476a-ba61-e2b99e8895c3" returned: 0 in 0.257s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-quobyte-0974006d-9e6c-476a-ba61-e2b99e8895c3" released by "delete_volume" :: held 0.659s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:48 devstack cinder-volume[94463]: DEBUG cinder.quota [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Created reservations ['804ad459-0bd1-439d-80ca-46bdbcd59f07', 'dd918430-96c1-4d32-9d51-2b9a8932c97f', '929707cf-87a3-4692-8a4f-93ea97b442a1', 'f0c01951-ba3d-4b04-930b-8ac1d256886f'] {{(pid=94463) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:50:49 devstack sudo[115182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:50:49 devstack sudo[115182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:50:49 devstack sudo[115182]: pam_unix(sudo:session): session closed for user root Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.271s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:50:49 devstack cinder-volume[94463]: INFO cinder.volume.manager [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Deleted volume successfully. Aug 11 06:50:49 devstack cinder-volume[94463]: DEBUG cinder.coordination [None req-6c614e41-4617-4127-8fb8-64a6e1e4d9c6 tempest-SnapshotDependencyTests-1153703375 None] Lock "cinder-0974006d-9e6c-476a-ba61-e2b99e8895c3-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94463) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 11 06:50:59 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:UPDATE=81,cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=4 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:50:59 devstack cinder-volume[94463]: DEBUG dbcounter [-] [94463] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=76,cinder:DELETE=8 {{(pid=94463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744': None} {{(pid=94463) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG cinder.volume.drivers.quobyte [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a681cce4-b6d0-415a-b86c-deddb5dce744'] {{(pid=94463) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.lockutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94463) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 11 06:51:15 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b Aug 11 06:51:15 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 11 06:51:15 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_concurrency.processutils [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65a712eeda467d0fba540e3df75b055b" returned: 0 in 0.260s {{(pid=94463) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG cinder.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Notifying Schedulers of capabilities ... {{(pid=94463) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG oslo_service.periodic_task [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] Running periodic task VolumeManager._thread_info {{(pid=94463) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread count: 28 {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 11 06:51:15 devstack cinder-volume[94463]: DEBUG cinder.volume.manager [None req-4f07a021-26bb-4cec-9b06-a925dad4ef6b None None] thread info: [<_MainThread(MainThread, started 139266036396160)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94463) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}